We started using HBase on EC2 sometime back in 2009. We thought that our data is important and we should have an option of restoring the data. We attached EBS volumes to our HBase nodes and configured HBase and Hadoop installation to store all the data on the attached EBS volumes. Then came the concept [...]
I was looking for a simple script that creates a new ebs snapshot and deletes all the previous snapshots except a few newest snapshots. I found a script written in php called manage snapshots at http://www.thecloudsaga.com/aws-ec2-manage-snapshots/. But the script only deletes snapshots. It does not create a new snapshot. That is why I decided to [...]
Amazon recently announced the AWS SDK for java. SDK or a java api is very much needed – especially if you are writing your automation scripts in groovy. We have tried multiple java apis in our scripts including JetS3t and Typica. These apis were really helpful, but they only supported some of the AWS services [...]
Amazon ec2 costs can grow very fast if you are not mindful of the Amazon ec2 billing structure. We came across the following ways to save money at our company. Keep machines in the same availability zone Don’t scatter your machines that talk to each other across multiple availability zones. You will end up paying [...]
Increasing size of your ebs volume is pretty easy. resize2fs does the trick. Here is the detailed procedure to increase size of your ebs volume. First detach the volume and take a snapshot of the volume. If you already have a snapshot and haven’t made any changes after that, no need to take a new [...]
Let’s say you have 10 ec2 instances up and they do various different kinds of work. Some are web servers, some are queue servers, some are cache servers and a cluster with hadoop/hbase. Have you found it hard to remember which server is which? Wouldn’t it be cool if Amazon let us name our servers? [...]
