Results 1 to 17 of 17
Thread: I/O Performance on Cloud
-
01-31-2011, 12:16 PM #1Web Hosting Master
- Join Date
- May 2001
- Location
- HK
- Posts
- 3,082
I/O Performance on Cloud
Can someone please give me some suggestions on the acceptable i/o performance people opt for when they are on a cloud virtual server (VDS/VPS on Cloud)? Like at what level (in terms of the speed of file creations, reading/writing, etc) we start to notice about the poor i/o performance within the guest OS?
Are there any benchmark web sites that I can look over the i/o performance between providers. I know about cloudharmony.com but the search are not working for me for days. Would be cool to know their technologies & infrastructure too - iScsi, FC, ipoib, etc.
Thanks for your help.Last edited by YUPAPA; 01-31-2011 at 12:24 PM.
-
01-31-2011, 01:06 PM #2Web Hosting Master
- Join Date
- Sep 2005
- Location
- London
- Posts
- 2,409
Hey, really hard to generalise here, but as a rule of thumb your avg. SATA drive will give you ~100IOPS (largely depending on drive size/type). There are a lot of drives doing better (SAS drives doing up to 300 IOPS). Obviously you can do take the SSD route that can bring you up to 10-20k IOPS.
Some of our clients deploy FusionIO cards giving them 400k+ IOPS per card.
On avg you should allocate 20-40 IOPS per VM deployed on a cloud. Now, some clients would go way above that, but most will be below - it's all about your client segment. That avg. is across more than 100 OnApp installs. OnApp typically aims for the mass market hosts, so you may find other IOPS KPI's in other segments.
DDitlev Bredahl. CEO,
OnApp.com + Cloud.net & CDN.net
-
01-31-2011, 01:27 PM #3Web Hosting Master
- Join Date
- Mar 2009
- Location
- NL
- Posts
- 594
I would run some bonnie++ and seeker benchmarks and post them here. You can also compare the results with some benchmark topic postings.
YISP - High Bandwidth dedicated servers and colocation in YISP-AS(Amsterdam)!
Website: http://www.yisp.nl
Contact: info "(AT)" yisp.nl
-
01-31-2011, 01:47 PM #4Web Hosting Master
- Join Date
- Sep 2005
- Location
- London
- Posts
- 2,409
-
02-01-2011, 12:37 AM #5Web Hosting Master
- Join Date
- Dec 2001
- Location
- Houston Texas
- Posts
- 4,420
-
02-01-2011, 05:30 AM #6Web Hosting Master
- Join Date
- Jun 2003
- Location
- London, UK
- Posts
- 1,765
Consider using RAM disks + replication and a good backup policy for high I/O requirements in the cloud. Amazon provide plenty of RAM with their instances for a reason... they don't want you going in to swap.
Darren Lingham - Stablepoint Hosting
Stablepoint - Cloud Web Hosting without compromise
We provide industry-leading cPanel™ web hosting in 80+ global cities.
-
02-01-2011, 05:43 AM #7Junior Guru Wannabe
- Join Date
- Oct 2009
- Location
- San Francisco, CA
- Posts
- 56
You might want to check out CloudHarmony.com, they've been doing some interesting benchmarking. In particular, you might want to check out their disk IO benchmarks post
John█ Stratosec Secure Cloud Services
█ Secure Cloud Services for Finance and Healthcare
-
02-01-2011, 05:46 AM #8Web Hosting Master
- Join Date
- Sep 2005
- Location
- London
- Posts
- 2,409
-
02-01-2011, 05:53 AM #9Web Hosting Master
- Join Date
- Jun 2003
- Location
- London, UK
- Posts
- 1,765
Darren Lingham - Stablepoint Hosting
Stablepoint - Cloud Web Hosting without compromise
We provide industry-leading cPanel™ web hosting in 80+ global cities.
-
02-01-2011, 11:56 AM #10Web Hosting Master
- Join Date
- Sep 2005
- Location
- London
- Posts
- 2,409
thanks...
On another note, a good way to deal with IOPS in your cloud is to separate the swap and primary storage on to individual SAN's.
When a VM starts swapping it tends to hit the SAN pretty hard and if your cloud platform allows you to allocate several storage units to the same VM, then that's a good way to alleviate some of the problems associated with IO intensive VM's. We've seen quite a few clients do that.
DDitlev Bredahl. CEO,
OnApp.com + Cloud.net & CDN.net
-
02-01-2011, 12:16 PM #11Cloud Hosting Pioneer
- Join Date
- Jan 2010
- Posts
- 1,030
Absolutely, and I completely agree. In cloud swap is an important thing to consider due to the way data is served. In our case with using AppLogic we have as many SAN's as servers basically (utilizing local storage pooled into virtual IP SANs basically) so we configure some servers to run the data streams of swap's, spread out the IO, etc. It's a little more work with the way the technology is today but it's also significantly cheaper than traditional redundant SANs, especially for smaller clouds and VPDC's for customers with just 3-6 servers or so.
-
02-02-2011, 10:48 PM #12Web Hosting Master
- Join Date
- May 2001
- Location
- HK
- Posts
- 3,082
Thanks.
According to this article here, http://cloudharmony.com/b/2010/06/di...-in-cloud.html, does it mean that Amazon service offerings can't even surpass the performance of a single SATA drive? You see most IOPs are under 100.
I always have a feeling that this can be scored much higher due to the fact that there are more servers handling the I/O and better throughput within the cloud environment, isn't it?Last edited by YUPAPA; 02-02-2011 at 10:52 PM.
-
02-02-2011, 11:05 PM #13Junior Guru Wannabe
- Join Date
- Oct 2009
- Location
- San Francisco, CA
- Posts
- 56
Unless you put a good amount of money/architecture into it, local disk is going to be faster than remote disk. If you set up a fancy infiniband or 10G san connected to a raid 10 with a bunch of spindles, it'll be faster than a local ssd. But that's not your average hosting SAN.
John█ Stratosec Secure Cloud Services
█ Secure Cloud Services for Finance and Healthcare
-
02-04-2011, 10:32 AM #14Junior Guru
- Join Date
- Apr 2008
- Posts
- 192
A well networked SAN cluster can outperform all but the geekiest-end local storage. There are providers emerging that can provide superior SAN performance on a cloud platform, without breaking the bank - to my mind, this is the future of hosting!
____________________________________________
European and USA IAAS Cloud Hosting
http://www.dediserve.com Dublin, London, Dallas
Ranked by Cloudharmony.com as the fastest cloud in the world.
-
02-04-2011, 10:54 AM #15Junior Guru Wannabe
- Join Date
- Oct 2009
- Location
- San Francisco, CA
- Posts
- 56
boskone - a pair of SDD drives will hit 500MB/sec. That's not really geeky in my book. I'd be happy to hear your suggestions for an economical 10gb connected SAN?
10G switchports alone costs more than an SDD drive...█ Stratosec Secure Cloud Services
█ Secure Cloud Services for Finance and Healthcare
-
02-04-2011, 11:02 AM #16Junior Guru
- Join Date
- Apr 2008
- Posts
- 192
Cloud customers pay for what they use - they dont have to worry about switchports, SAN's or anything else, that's the whole point of the cloud.
It's up to the provider to deliver the performance at the right price.
If you need 500MB/sec to your storage, cloud ain't for you in the first place (not yet anyway ) But those kind of requirements are representative of 0.01% of the websites/apps out there that need hosting in the first place.____________________________________________
European and USA IAAS Cloud Hosting
http://www.dediserve.com Dublin, London, Dallas
Ranked by Cloudharmony.com as the fastest cloud in the world.
-
02-06-2011, 02:48 AM #17Web Hosting Master
- Join Date
- May 2001
- Location
- HK
- Posts
- 3,082
Thanks. I appreciated everyones feedback.
Last edited by YUPAPA; 02-06-2011 at 02:53 AM.
Similar Threads
-
Cloud Web - TRUE CLOUD cPanel Reseller Hosting, 99.99% Uptime Guarantee | 25% OFF
By JasonD10 in forum Reseller Hosting OffersReplies: 0Last Post: 11-15-2010, 04:05 PM -
Cloud Web - CLOUD cPanel Reseller Hosting, 99.99% Uptime Guarantee, WHMCS | 25% OFF!
By JasonD10 in forum Reseller Hosting OffersReplies: 2Last Post: 10-30-2010, 04:42 PM -
Cloud Web - CLOUD cPanel Reseller Hosting, 99.99% Uptime Guarantee, WHMCS | 25% OFF!
By JasonD10 in forum Reseller Hosting OffersReplies: 0Last Post: 09-14-2010, 09:31 PM -
Cloud Web - CLOUD cPanel Reseller Hosting, 99.99% Uptime Guarantee, WHMCS | 25% OFF!
By JasonD10 in forum Reseller Hosting OffersReplies: 0Last Post: 08-16-2010, 02:20 PM -
Cloud Web - CLOUD cPanel Reseller Hosting, 99.99% Uptime Guarantee, WHMCS | 25% OFF!
By JasonD10 in forum Reseller Hosting OffersReplies: 0Last Post: 07-12-2010, 11:22 AM