All Posts Tagged With: "aws"

post thumbnail

Playing with NFS & GlusterFS on Amazon cc1.4xlarge EC2 instance types

Early single-client tests of shared ephemeral storage via NFS and parallel GlusterFS We here at BioTeam have been kicking tires and generally exploring around the edges of the new Amazon cc1.4xlarge “compute cluster” EC2 instance types. Much of our experimentation has been centered around simplistic benchmarking techniques as a way of slowly zeroing in on [...]

  • Share/Bookmark
29Jul2010 | chrisdag | 5 comments | Continued
post thumbnail

Boot, ephemeral & EBS storage performance on amazon cc1.4xlarge instance types

Backstory For background and summary writeups of all the various blog posts we have dealing with the new Amazon EC2 “compute cluster” cc1.4xlarge instance types please refer to this summary page: http://blog.bioteam.net/2010/07/19/exploring-the-new-aws-compute-cluster-ec2-instances/? Related post We talked about the performance of the boot and ephemeral storage in this post: http://blog.bioteam.net/2010/07/19/local-storage-performance-of-aws-cluster-compute-instances/? This post In this post I’ve finally collected [...]

  • Share/Bookmark
20Jul2010 | chrisdag | 0 comments | Continued
post thumbnail

Exploring the new AWS Compute Cluster EC2 Instances

Note: Depending on how you found this post, it might be helpful to understand our own personal & professional biases. We are bioinformatics and HPC types specializing in life sciences, not people trying to build the next twitter or facebook. What we care about when it comes to AWS performance may not be what YOU [...]

  • Share/Bookmark
19Jul2010 | chrisdag | 0 comments | Continued
post thumbnail

Local storage performance of AWS cluster compute instances

Lots more data collected over the weekend as we were finally able to run bonnie++ against the local boot disk as well as single and striped versions of the ephermeral storage volumes that come along with every cc1.4xlarge instance type. Key Results: Performance of the root/boot disk is way slower than any other type of [...]

  • Share/Bookmark
19Jul2010 | chrisdag | 0 comments | Continued
post thumbnail

How to resize an Amazon EC2 AMI when boot disk is on EBS

Note Screwing around with the boot volume is part of our regular “explore around the edges” work before we get serious with how we are going to configure and orchestrate the new systems. The boot volume in this scenario does not have PV driver support and thus will perform slower than the actual ephemeral storage. [...]

  • Share/Bookmark
14Jul2010 | chrisdag | 2 comments | Continued
post thumbnail

Preliminary EBS performance on Amazon Compute Cluster cc1.4xlarge instance types

Post Update History: July 13th – Original post July 14th – More results from cc1.4xlarge single-disk & initial results from c1.xlarge instance type, uploaded new version of the raw data spreadsheet to Google Docs. Updated all graphs. July 19th – Lots more data (including ephemeral storage) added to the raw data spreadsheet on Google Docs [...]

  • Share/Bookmark
13Jul2010 | chrisdag | 0 comments | Continued
post thumbnail

Great talk on hadoop, bioinformatics and the cloud

Just passing along the URL to a pretty informative video showing Deepak Singh’s talk at a recent NYC area Hadoop World conference. The presentation contains quite a bit of bioinformatics/IT background that some readers here may already know but the Hadoop and large-scale dataset processing content is really quite interesting. If you work at the [...]

  • Share/Bookmark
2Dec2009 | chrisdag | 0 comments | Continued
post thumbnail

Maximizing Utility on the Cloud

For the 2009 BioIT World Conference in Europe I was invited with short notice to give a 60 minute talk centering on practical Cloud approaches for life science organizations. The talk was not really technical in nature and had to hit a huge number of topic areas as well. Overall feedback was positive and a [...]

  • Share/Bookmark
16Oct2009 | chrisdag | 1 comment | Continued