feature photo

Feature Article #1

Exploring the new AWS Compute Cluster EC2 Instances

Note: Depending on how you found this post, it might be helpful to understand our own personal & professional biases. We are bioinformatics and HPC types specializing in life sciences, not people trying to build the next twitter or facebook. What we care about when it comes to AWS performance may not be what YOU [...]

  • Share/Bookmark

chrisdag | July 19th, 2010 | Continued

feature photo

Feature Article #2

Slides from the Amazon Web Services Genomics meeting

I had the unenviable task of giving the first talk after James Hamilton presented the opening keynote at the Amazon Web Services Genomics meeting James is one of the very very few people writing and talking in public about the sorts of things the mega internet scale companies are doing to drive costs down and [...]

  • Share/Bookmark

chrisdag | June 8th, 2010 | Continued

feature photo

Feature Article #3

WikiLIMS and Toxicogenomics

Stephen Edwards was kind enough to provide his talk slides from his “Wiki-Based Data Management System for Toxicogenomics” presentation at the 2010 Bio-IT-World Conference & Expo. Click on the graphic below to download the PDF formatted version of his presentation.

  • Share/Bookmark

blogadmin | April 25th, 2010 | Continued

feature photo

Feature Article #4

CHI XGEN Short Course Slides

As promised, here are the PDF talk slides from the sessions presented at our Short Course on Data Management Strategies for Next-Generation DNA Sequencing — part of the XGEN Congress held in San Diego.

  • Share/Bookmark

chrisdag | March 15th, 2010 | Continued

feature photo

Feature Article #5

Supporting Haiti

On Friday the 29th of January, I will be taking a week’s leave of absence from my day to day responsibilities at Bioteam and traveling to Haiti with a medical relief team. I’ll be going with a group called Family Health Ministries. We’ll go overland through the Dominican Republic to a clinic where my wife [...]

  • Share/Bookmark

cdwan | January 26th, 2010 | Continued

feature photo

Feature Article #6

Maximizing Utility on the Cloud

For the 2009 BioIT World Conference in Europe I was invited with short notice to give a 60 minute talk centering on practical Cloud approaches for life science organizations. The talk was not really technical in nature and had to hit a huge number of topic areas as well. Overall feedback was positive and a [...]

  • Share/Bookmark

chrisdag | October 16th, 2009 | Continued

feature photo

Feature Article #7

Storage for Next-Gen Sequencing

Presenter slides from the 2009 Storage for Next-Generation Sequencing Workshop(s)

  • Share/Bookmark

blogadmin | October 16th, 2009 | Continued

feature photo

Feature Article #8

Antibody Docking in the Amazon Cloud

Adam Kraut has written up his experiences with a Pfizer protein docking experiment on Amazon AWS in a recent BioIT World column: “… The new docking architecture at Pfizer employs nearly the entire suite of services offered by Amazon. A huge array of Rosetta workers can be spun up on EC2 by a single protein [...]

  • Share/Bookmark

blogadmin | May 29th, 2009 | Continued

About this Site

BioTeam is using this site as a means to publish information (especially XML RSS feeds) about our latest scientific, community and professional activities including information about our latest speaking engagements, publications, training seminars and conference activities.

  • Share/Bookmark

Other Recent Articles

post thumbnail

Playing with NFS & GlusterFS on Amazon cc1.4xlarge EC2 instance types

Early single-client tests of shared ephemeral storage via NFS and parallel GlusterFS We here at BioTeam have been kicking tires and generally exploring around the edges of the new Amazon cc1.4xlarge “compute cluster” EC2 instance types. Much of our experimentation has been centered around simplistic benchmarking techniques as a way of slowly zeroing in on [...]

  • Share/Bookmark
29Jul2010 | chrisdag | 5 comments | Continued
post thumbnail

Boot, ephemeral & EBS storage performance on amazon cc1.4xlarge instance types

Backstory For background and summary writeups of all the various blog posts we have dealing with the new Amazon EC2 “compute cluster” cc1.4xlarge instance types please refer to this summary page: http://blog.bioteam.net/2010/07/19/exploring-the-new-aws-compute-cluster-ec2-instances/? Related post We talked about the performance of the boot and ephemeral storage in this post: http://blog.bioteam.net/2010/07/19/local-storage-performance-of-aws-cluster-compute-instances/? This post In this post I’ve finally collected [...]

  • Share/Bookmark
20Jul2010 | chrisdag | 0 comments | Continued
post thumbnail

Local storage performance of AWS cluster compute instances

Lots more data collected over the weekend as we were finally able to run bonnie++ against the local boot disk as well as single and striped versions of the ephermeral storage volumes that come along with every cc1.4xlarge instance type. Key Results: Performance of the root/boot disk is way slower than any other type of [...]

  • Share/Bookmark
19Jul2010 | chrisdag | 0 comments | Continued
post thumbnail

How to resize an Amazon EC2 AMI when boot disk is on EBS

Note Screwing around with the boot volume is part of our regular “explore around the edges” work before we get serious with how we are going to configure and orchestrate the new systems. The boot volume in this scenario does not have PV driver support and thus will perform slower than the actual ephemeral storage. [...]

  • Share/Bookmark
14Jul2010 | chrisdag | 2 comments | Continued
post thumbnail

Preliminary EBS performance on Amazon Compute Cluster cc1.4xlarge instance types

Post Update History: July 13th – Original post July 14th – More results from cc1.4xlarge single-disk & initial results from c1.xlarge instance type, uploaded new version of the raw data spreadsheet to Google Docs. Updated all graphs. July 19th – Lots more data (including ephemeral storage) added to the raw data spreadsheet on Google Docs [...]

  • Share/Bookmark
13Jul2010 | chrisdag | 0 comments | Continued
post thumbnail

Grid Engine on the new Amazon Compute Cluster Instances

{ crossposted to blog.bioteam.net and gridengine.info } Amazon made a very important announcement today, releasing new EC2 server types and network configurations that significantly enhance the Amazon AWS environment for people who are interested in cluster computing, compute farming and high performance computing (HPC) on the cloud. The announcement is here for those who are [...]

  • Share/Bookmark
13Jul2010 | chrisdag | 0 comments | Continued
post thumbnail

2010 ISMB Amazon Cloud Workshop Slides

Later than I’d like but as promised to attendees of the ISBM 2010 meeting in Boston, here are my presentation slides from the Amazon Cloud Computing Workshop. Link: http://blog.bioteam.net/wp-content/uploads/2010/07/2010-ISMB-Cloud-Workshop_v1.pdf

  • Share/Bookmark
13Jul2010 | chrisdag | 0 comments | Continued
post thumbnail

Cluster building

With all of Bioteam’s talk about cloud computing, I was a bit surprised to find myself building an honest-to-goodness non-cloud, non-virtual compute cluster a couple of weeks ago. There were wires, blinking lights, whirring fans, circuit breakers, and all sorts of messy real-world details to contend with. The servers were heavy and unwieldy, and I [...]

  • Share/Bookmark
23Jun2010 | cdwan | 0 comments | Continued