Results 1 to 17 of 17
  1. #1
    Join Date
    May 2001
    Location
    HK
    Posts
    3,082

    * I/O Performance on Cloud

    Can someone please give me some suggestions on the acceptable i/o performance people opt for when they are on a cloud virtual server (VDS/VPS on Cloud)? Like at what level (in terms of the speed of file creations, reading/writing, etc) we start to notice about the poor i/o performance within the guest OS?

    Are there any benchmark web sites that I can look over the i/o performance between providers. I know about cloudharmony.com but the search are not working for me for days. Would be cool to know their technologies & infrastructure too - iScsi, FC, ipoib, etc.

    Thanks for your help.
    Last edited by YUPAPA; 01-31-2011 at 12:24 PM.

  2. #2
    Join Date
    Sep 2005
    Location
    London
    Posts
    2,409
    Hey, really hard to generalise here, but as a rule of thumb your avg. SATA drive will give you ~100IOPS (largely depending on drive size/type). There are a lot of drives doing better (SAS drives doing up to 300 IOPS). Obviously you can do take the SSD route that can bring you up to 10-20k IOPS.

    Some of our clients deploy FusionIO cards giving them 400k+ IOPS per card.

    On avg you should allocate 20-40 IOPS per VM deployed on a cloud. Now, some clients would go way above that, but most will be below - it's all about your client segment. That avg. is across more than 100 OnApp installs. OnApp typically aims for the mass market hosts, so you may find other IOPS KPI's in other segments.


    D
    Ditlev Bredahl. CEO,
    OnApp.com + Cloud.net & CDN.net

  3. #3
    Join Date
    Mar 2009
    Location
    NL
    Posts
    594
    I would run some bonnie++ and seeker benchmarks and post them here. You can also compare the results with some benchmark topic postings.
    YISP - High Bandwidth dedicated servers and colocation in YISP-AS(Amsterdam)!

    Website: http://www.yisp.nl
    Contact: info "(AT)" yisp.nl

  4. #4
    Join Date
    Sep 2005
    Location
    London
    Posts
    2,409
    Quote Originally Posted by Rens View Post
    I would run some bonnie++ and seeker benchmarks and post them here. You can also compare the results with some benchmark topic postings.
    yeah, Bonnie sometimes show some funky results on VM's though...


    D
    Ditlev Bredahl. CEO,
    OnApp.com + Cloud.net & CDN.net

  5. #5
    Join Date
    Dec 2001
    Location
    Houston Texas
    Posts
    4,420
    Quote Originally Posted by eming View Post
    yeah, Bonnie sometimes show some funky results on VM's though...


    D
    and some providers will jump on you if you are doing this on the production san
    Dedicated Servers
    WWW.NETDEPOT.COM
    Since 2000

  6. #6
    Join Date
    Jun 2003
    Location
    London, UK
    Posts
    1,765
    Consider using RAM disks + replication and a good backup policy for high I/O requirements in the cloud. Amazon provide plenty of RAM with their instances for a reason... they don't want you going in to swap.
    Darren Lingham - Stablepoint Hosting
    Stablepoint - Cloud Web Hosting without compromise
    We provide industry-leading cPanel™ web hosting in 80+ global cities.

  7. #7
    Join Date
    Oct 2009
    Location
    San Francisco, CA
    Posts
    56
    You might want to check out CloudHarmony.com, they've been doing some interesting benchmarking. In particular, you might want to check out their disk IO benchmarks post

    John
    Stratosec Secure Cloud Services
    Secure Cloud Services for Finance and Healthcare

  8. #8
    Join Date
    Sep 2005
    Location
    London
    Posts
    2,409
    Quote Originally Posted by sailor View Post
    and some providers will jump on you if you are doing this on the production san
    and rightly so....running bonnie/hdparm/etc can kill performance for any SAN.
    Also, we see OnApp clients starting to charge for IOPS as a resource ... and running bonnie would cost you a lot of $$ in that case


    D
    Ditlev Bredahl. CEO,
    OnApp.com + Cloud.net & CDN.net

  9. #9
    Join Date
    Jun 2003
    Location
    London, UK
    Posts
    1,765
    Quote Originally Posted by eming View Post
    Also, we see OnApp clients starting to charge for IOPS as a resource ...
    What software is available for monitoring/metering I/O in this way? Is it SAN based or is it on the hypervisor?
    Darren Lingham - Stablepoint Hosting
    Stablepoint - Cloud Web Hosting without compromise
    We provide industry-leading cPanel™ web hosting in 80+ global cities.

  10. #10
    Join Date
    Sep 2005
    Location
    London
    Posts
    2,409
    Quote Originally Posted by CloudWeb View Post
    Nice feature
    thanks...

    On another note, a good way to deal with IOPS in your cloud is to separate the swap and primary storage on to individual SAN's.
    When a VM starts swapping it tends to hit the SAN pretty hard and if your cloud platform allows you to allocate several storage units to the same VM, then that's a good way to alleviate some of the problems associated with IO intensive VM's. We've seen quite a few clients do that.


    D
    Ditlev Bredahl. CEO,
    OnApp.com + Cloud.net & CDN.net

  11. #11
    Join Date
    Jan 2010
    Posts
    1,030
    Quote Originally Posted by eming View Post
    thanks...

    On another note, a good way to deal with IOPS in your cloud is to separate the swap and primary storage on to individual SAN's.
    When a VM starts swapping it tends to hit the SAN pretty hard and if your cloud platform allows you to allocate several storage units to the same VM, then that's a good way to alleviate some of the problems associated with IO intensive VM's. We've seen quite a few clients do that.


    D
    Absolutely, and I completely agree. In cloud swap is an important thing to consider due to the way data is served. In our case with using AppLogic we have as many SAN's as servers basically (utilizing local storage pooled into virtual IP SANs basically) so we configure some servers to run the data streams of swap's, spread out the IO, etc. It's a little more work with the way the technology is today but it's also significantly cheaper than traditional redundant SANs, especially for smaller clouds and VPDC's for customers with just 3-6 servers or so.

  12. #12
    Join Date
    May 2001
    Location
    HK
    Posts
    3,082

    *

    Quote Originally Posted by eming View Post
    Hey, really hard to generalise here, but as a rule of thumb your avg. SATA drive will give you ~100IOPS (largely depending on drive size/type). There are a lot of drives doing better (SAS drives doing up to 300 IOPS). Obviously you can do take the SSD route that can bring you up to 10-20k IOPS.
    Thanks.

    According to this article here, http://cloudharmony.com/b/2010/06/di...-in-cloud.html, does it mean that Amazon service offerings can't even surpass the performance of a single SATA drive? You see most IOPs are under 100.

    I always have a feeling that this can be scored much higher due to the fact that there are more servers handling the I/O and better throughput within the cloud environment, isn't it?
    Last edited by YUPAPA; 02-02-2011 at 10:52 PM.

  13. #13
    Join Date
    Oct 2009
    Location
    San Francisco, CA
    Posts
    56
    Quote Originally Posted by YUPAPA View Post
    Thanks.

    According to this article here, http://cloudharmony.com/b/2010/06/di...-in-cloud.html, does it mean that Amazon service offerings can't even surpass the performance of a single SATA drive? You see most IOPs are under 100.

    I always have a feeling that this can be scored much higher due to the fact that there are more servers handling the I/O and better throughput within the cloud environment, isn't it?
    Unless you put a good amount of money/architecture into it, local disk is going to be faster than remote disk. If you set up a fancy infiniband or 10G san connected to a raid 10 with a bunch of spindles, it'll be faster than a local ssd. But that's not your average hosting SAN.

    John
    Stratosec Secure Cloud Services
    Secure Cloud Services for Finance and Healthcare

  14. #14
    A well networked SAN cluster can outperform all but the geekiest-end local storage. There are providers emerging that can provide superior SAN performance on a cloud platform, without breaking the bank - to my mind, this is the future of hosting!
    ____________________________________________
    European and USA IAAS Cloud Hosting
    http://www.dediserve.com Dublin, London, Dallas
    Ranked by Cloudharmony.com as the fastest cloud in the world.

  15. #15
    Join Date
    Oct 2009
    Location
    San Francisco, CA
    Posts
    56
    boskone - a pair of SDD drives will hit 500MB/sec. That's not really geeky in my book. I'd be happy to hear your suggestions for an economical 10gb connected SAN?

    10G switchports alone costs more than an SDD drive...
    Stratosec Secure Cloud Services
    Secure Cloud Services for Finance and Healthcare

  16. #16
    Cloud customers pay for what they use - they dont have to worry about switchports, SAN's or anything else, that's the whole point of the cloud.

    It's up to the provider to deliver the performance at the right price.

    If you need 500MB/sec to your storage, cloud ain't for you in the first place (not yet anyway ) But those kind of requirements are representative of 0.01% of the websites/apps out there that need hosting in the first place.
    ____________________________________________
    European and USA IAAS Cloud Hosting
    http://www.dediserve.com Dublin, London, Dallas
    Ranked by Cloudharmony.com as the fastest cloud in the world.

  17. #17
    Join Date
    May 2001
    Location
    HK
    Posts
    3,082

    *

    Thanks. I appreciated everyones feedback.
    Last edited by YUPAPA; 02-06-2011 at 02:53 AM.

Similar Threads

  1. Replies: 0
    Last Post: 11-15-2010, 04:05 PM
  2. Replies: 2
    Last Post: 10-30-2010, 04:42 PM
  3. Replies: 0
    Last Post: 09-14-2010, 09:31 PM
  4. Replies: 0
    Last Post: 08-16-2010, 02:20 PM
  5. Replies: 0
    Last Post: 07-12-2010, 11:22 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •