hosted by liquidweb


Go Back   Web Hosting Talk : Web Hosting Main Forums : Cloud Hosting : I/O Performance on Cloud
Reply

Forum Jump

I/O Performance on Cloud

Reply Post New Thread In Cloud Hosting Subscription
 
Send news tip View All Posts Thread Tools Search this Thread Display Modes
  #1  
Old 01-31-2011, 12:16 PM
YUPAPA YUPAPA is offline
Quant Trader
 
Join Date: May 2001
Location: HK
Posts: 2,997
*

I/O Performance on Cloud


Can someone please give me some suggestions on the acceptable i/o performance people opt for when they are on a cloud virtual server (VDS/VPS on Cloud)? Like at what level (in terms of the speed of file creations, reading/writing, etc) we start to notice about the poor i/o performance within the guest OS?

Are there any benchmark web sites that I can look over the i/o performance between providers. I know about cloudharmony.com but the search are not working for me for days. Would be cool to know their technologies & infrastructure too - iScsi, FC, ipoib, etc.

Thanks for your help.


Last edited by YUPAPA; 01-31-2011 at 12:24 PM.


Sponsored Links
  #2  
Old 01-31-2011, 01:06 PM
eming eming is offline
Web Hosting Master
 
Join Date: Sep 2005
Location: London
Posts: 2,352
Hey, really hard to generalise here, but as a rule of thumb your avg. SATA drive will give you ~100IOPS (largely depending on drive size/type). There are a lot of drives doing better (SAS drives doing up to 300 IOPS). Obviously you can do take the SSD route that can bring you up to 10-20k IOPS.

Some of our clients deploy FusionIO cards giving them 400k+ IOPS per card.

On avg you should allocate 20-40 IOPS per VM deployed on a cloud. Now, some clients would go way above that, but most will be below - it's all about your client segment. That avg. is across more than 100 OnApp installs. OnApp typically aims for the mass market hosts, so you may find other IOPS KPI's in other segments.


D

__________________
Ditlev Bredahl. CEO, OnApp.com The Cloud Platform that also manages your Dedicated servers and CDN services.

Give it a spin at www.TryOnApp.com, and see why we're behind 1 out of 3 public clouds online.

  #3  
Old 01-31-2011, 01:27 PM
Rens Rens is offline
Web Hosting Evangelist
 
Join Date: Mar 2009
Location: NL
Posts: 543
I would run some bonnie++ and seeker benchmarks and post them here. You can also compare the results with some benchmark topic postings.

__________________
YISP - High Bandwidth dedicated servers and colocation in YISP-AS(Amsterdam)!

Website: http://www.yisp.com
Contact: info "(AT)" yisp.com

Sponsored Links
  #4  
Old 01-31-2011, 01:47 PM
eming eming is offline
Web Hosting Master
 
Join Date: Sep 2005
Location: London
Posts: 2,352
Quote:
Originally Posted by Rens View Post
I would run some bonnie++ and seeker benchmarks and post them here. You can also compare the results with some benchmark topic postings.
yeah, Bonnie sometimes show some funky results on VM's though...


D

__________________
Ditlev Bredahl. CEO, OnApp.com The Cloud Platform that also manages your Dedicated servers and CDN services.

Give it a spin at www.TryOnApp.com, and see why we're behind 1 out of 3 public clouds online.

  #5  
Old 02-01-2011, 12:37 AM
sailor sailor is offline
Web Hosting Master
 
Join Date: Dec 2001
Location: Atlanta
Posts: 4,419
Quote:
Originally Posted by eming View Post
yeah, Bonnie sometimes show some funky results on VM's though...


D
and some providers will jump on you if you are doing this on the production san

__________________
Dedicated Servers
WWW.NETDEPOT.COM
Since 2000

  #6  
Old 02-01-2011, 05:30 AM
dazmanultra dazmanultra is offline
Web Hosting Master
 
Join Date: Jun 2003
Location: London, UK
Posts: 1,722
Consider using RAM disks + replication and a good backup policy for high I/O requirements in the cloud. Amazon provide plenty of RAM with their instances for a reason... they don't want you going in to swap.

__________________
Darren Lingham - UK Webhosting Ltd. - (0800) 024 2931
Tsohost.co.uk - Quality UK Windows and Linux hosting since 2003
UK WordPress Hosting - Fast, easy, cloud based WordPress Hosting

  #7  
Old 02-01-2011, 05:43 AM
jlkinsel jlkinsel is offline
Junior Guru Wannabe
 
Join Date: Oct 2009
Location: San Francisco, CA
Posts: 54
You might want to check out CloudHarmony.com, they've been doing some interesting benchmarking. In particular, you might want to check out their disk IO benchmarks post

John

__________________
Stratosec Secure Cloud Services
Secure Cloud Services for Finance and Healthcare

  #8  
Old 02-01-2011, 05:46 AM
eming eming is offline
Web Hosting Master
 
Join Date: Sep 2005
Location: London
Posts: 2,352
Quote:
Originally Posted by sailor View Post
and some providers will jump on you if you are doing this on the production san
and rightly so....running bonnie/hdparm/etc can kill performance for any SAN.
Also, we see OnApp clients starting to charge for IOPS as a resource ... and running bonnie would cost you a lot of $$ in that case


D

__________________
Ditlev Bredahl. CEO, OnApp.com The Cloud Platform that also manages your Dedicated servers and CDN services.

Give it a spin at www.TryOnApp.com, and see why we're behind 1 out of 3 public clouds online.

  #9  
Old 02-01-2011, 05:53 AM
dazmanultra dazmanultra is offline
Web Hosting Master
 
Join Date: Jun 2003
Location: London, UK
Posts: 1,722
Quote:
Originally Posted by eming View Post
Also, we see OnApp clients starting to charge for IOPS as a resource ...
What software is available for monitoring/metering I/O in this way? Is it SAN based or is it on the hypervisor?

__________________
Darren Lingham - UK Webhosting Ltd. - (0800) 024 2931
Tsohost.co.uk - Quality UK Windows and Linux hosting since 2003
UK WordPress Hosting - Fast, easy, cloud based WordPress Hosting

  #10  
Old 02-01-2011, 11:56 AM
eming eming is offline
Web Hosting Master
 
Join Date: Sep 2005
Location: London
Posts: 2,352
Quote:
Originally Posted by CloudWeb View Post
Nice feature
thanks...

On another note, a good way to deal with IOPS in your cloud is to separate the swap and primary storage on to individual SAN's.
When a VM starts swapping it tends to hit the SAN pretty hard and if your cloud platform allows you to allocate several storage units to the same VM, then that's a good way to alleviate some of the problems associated with IO intensive VM's. We've seen quite a few clients do that.


D

__________________
Ditlev Bredahl. CEO, OnApp.com The Cloud Platform that also manages your Dedicated servers and CDN services.

Give it a spin at www.TryOnApp.com, and see why we're behind 1 out of 3 public clouds online.

  #11  
Old 02-01-2011, 12:16 PM
CloudWeb CloudWeb is offline
Cloud Hosting Expert
 
Join Date: Jan 2010
Posts: 1,028
Quote:
Originally Posted by eming View Post
thanks...

On another note, a good way to deal with IOPS in your cloud is to separate the swap and primary storage on to individual SAN's.
When a VM starts swapping it tends to hit the SAN pretty hard and if your cloud platform allows you to allocate several storage units to the same VM, then that's a good way to alleviate some of the problems associated with IO intensive VM's. We've seen quite a few clients do that.


D
Absolutely, and I completely agree. In cloud swap is an important thing to consider due to the way data is served. In our case with using AppLogic we have as many SAN's as servers basically (utilizing local storage pooled into virtual IP SANs basically) so we configure some servers to run the data streams of swap's, spread out the IO, etc. It's a little more work with the way the technology is today but it's also significantly cheaper than traditional redundant SANs, especially for smaller clouds and VPDC's for customers with just 3-6 servers or so.

__________________
Cloud Web - SSD Cloud Hosting & Cloud Reseller Services
Cloud Web grows with your site, and even if a server crashes your site remains available.
TRUE Cloud, Affordable, 14 Years of Success in Web Hosting
Data Centers in Ashburn, VA | Seattle, WA | Dallas, TX

  #12  
Old 02-02-2011, 10:48 PM
YUPAPA YUPAPA is offline
Quant Trader
 
Join Date: May 2001
Location: HK
Posts: 2,997
*

Quote:
Originally Posted by eming View Post
Hey, really hard to generalise here, but as a rule of thumb your avg. SATA drive will give you ~100IOPS (largely depending on drive size/type). There are a lot of drives doing better (SAS drives doing up to 300 IOPS). Obviously you can do take the SSD route that can bring you up to 10-20k IOPS.
Thanks.

According to this article here, http://cloudharmony.com/b/2010/06/di...-in-cloud.html, does it mean that Amazon service offerings can't even surpass the performance of a single SATA drive? You see most IOPs are under 100.

I always have a feeling that this can be scored much higher due to the fact that there are more servers handling the I/O and better throughput within the cloud environment, isn't it?


Last edited by YUPAPA; 02-02-2011 at 10:52 PM.
  #13  
Old 02-02-2011, 11:05 PM
jlkinsel jlkinsel is offline
Junior Guru Wannabe
 
Join Date: Oct 2009
Location: San Francisco, CA
Posts: 54
Quote:
Originally Posted by YUPAPA View Post
Thanks.

According to this article here, http://cloudharmony.com/b/2010/06/di...-in-cloud.html, does it mean that Amazon service offerings can't even surpass the performance of a single SATA drive? You see most IOPs are under 100.

I always have a feeling that this can be scored much higher due to the fact that there are more servers handling the I/O and better throughput within the cloud environment, isn't it?
Unless you put a good amount of money/architecture into it, local disk is going to be faster than remote disk. If you set up a fancy infiniband or 10G san connected to a raid 10 with a bunch of spindles, it'll be faster than a local ssd. But that's not your average hosting SAN.

John

__________________
Stratosec Secure Cloud Services
Secure Cloud Services for Finance and Healthcare

  #14  
Old 02-04-2011, 10:32 AM
boskone boskone is offline
Junior Guru
 
Join Date: Apr 2008
Posts: 192
A well networked SAN cluster can outperform all but the geekiest-end local storage. There are providers emerging that can provide superior SAN performance on a cloud platform, without breaking the bank - to my mind, this is the future of hosting!

__________________
____________________________________________
European and USA IAAS Cloud Hosting
http://www.dediserve.com Dublin, London, Dallas
Ranked by Cloudharmony.com as the fastest cloud in the world.

  #15  
Old 02-04-2011, 10:54 AM
jlkinsel jlkinsel is offline
Junior Guru Wannabe
 
Join Date: Oct 2009
Location: San Francisco, CA
Posts: 54
boskone - a pair of SDD drives will hit 500MB/sec. That's not really geeky in my book. I'd be happy to hear your suggestions for an economical 10gb connected SAN?

10G switchports alone costs more than an SDD drive...

__________________
Stratosec Secure Cloud Services
Secure Cloud Services for Finance and Healthcare

Reply

Similar Threads
Thread Thread Starter Forum Replies Last Post
Cloud Web - TRUE CLOUD cPanel Reseller Hosting, 99.99% Uptime Guarantee | 25% OFF CloudWeb Reseller Hosting Offers 0 11-15-2010 04:05 PM
Cloud Web - CLOUD cPanel Reseller Hosting, 99.99% Uptime Guarantee, WHMCS | 25% OFF! CloudWeb Reseller Hosting Offers 2 10-30-2010 04:42 PM
Cloud Web - CLOUD cPanel Reseller Hosting, 99.99% Uptime Guarantee, WHMCS | 25% OFF! CloudWeb Reseller Hosting Offers 0 09-14-2010 09:31 PM
Cloud Web - CLOUD cPanel Reseller Hosting, 99.99% Uptime Guarantee, WHMCS | 25% OFF! CloudWeb Reseller Hosting Offers 0 08-16-2010 02:20 PM
Cloud Web - CLOUD cPanel Reseller Hosting, 99.99% Uptime Guarantee, WHMCS | 25% OFF! CloudWeb Reseller Hosting Offers 0 07-12-2010 11:22 AM

Related posts from TheWhir.com
Title Type Date Posted
Australian Ecommerce Host Anchor Readies New OpenStack Managed Cloud Web Hosting News 2014-07-25 06:47:00
Rackspace Brings Performance Cloud Servers to Hong Kong Web Hosting News 2014-06-27 13:08:50
Cloud Performance Challenges Outweigh Security Concerns for Cloud-Savvy Organizations: Study Web Hosting News 2014-01-14 11:37:44
Datapipe Picks SolidFire as Primary Storage System for High Performance Cloud Web Hosting News 2013-12-04 14:14:54
Rackspace Updates Public Cloud Servers for Speedy Application Performance Web Hosting News 2013-11-05 10:54:19


Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes
Postbit Selector

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off

Forum Jump
Login:
Log in with your username and password
Username:
Password:



Forgot Password?
Advertisement:
Web Hosting News:



 

X

Welcome to WebHostingTalk.com

Create your username to jump into the discussion!

WebHostingTalk.com is the largest, most influentual web hosting community on the Internet. Join us by filling in the form below.


(4 digit year)

Already a member?