hosted by liquidweb


Go Back   Web Hosting Talk : Web Hosting Main Forums : Cloud Hosting : "Scaling"
Reply

Forum Jump

"Scaling"

Reply Post New Thread In Cloud Hosting Subscription
 
Send news tip View All Posts Thread Tools Search this Thread Display Modes
  #1  
Old
Newbie
 
Join Date: Nov 2010
Posts: 17

"Scaling"


I'm reading up on clouds, the infrastructure, design, etc. but im a little confused on the "scaling" part of it.

In example, and in simplistic terms, if I have 2 servers each with 128 megs of ram within my cloud and I have one client who has purchased 128 megs of RAM for just one of his hugemongous VM's using all resources on one of the servers, and then decides to "scale" to use more ram, say 256MB, how is it possible that his VM can use the extra ram when its on a completly different server?

I use RAM as just an example, but any resource for that matter whether is disk space, ram, etc. still applies for the question.

Im am absolutely sure im misunderstanding the concept. I'm reading through a book, and thought i'd ask this while it was fresh on my mind.



Sponsored Links
  #2  
Old
Web Hosting Master
 
Join Date: Jan 2011
Location: UK
Posts: 776
Quote:
Originally Posted by saki2fifty View Post
I'm reading up on clouds, the infrastructure, design, etc. but im a little confused on the "scaling" part of it.

In example, and in simplistic terms, if I have 2 servers each with 128 megs of ram within my cloud and I have one client who has purchased 128 megs of RAM for just one of his hugemongous VM's using all resources on one of the servers, and then decides to "scale" to use more ram, say 256MB, how is it possible that his VM can use the extra ram when its on a completly different server?

I use RAM as just an example, but any resource for that matter whether is disk space, ram, etc. still applies for the question.

Im am absolutely sure im misunderstanding the concept. I'm reading through a book, and thought i'd ask this while it was fresh on my mind.
It's not possible and you have understood it just fine!

You'll hear about vertical and horizontal scaling, vertical being eg adding RAM to an instance, horizontal being adding more instances. The vertical scaling of the RAM is limited to the amount available to the VM in the machine it's running on. Same to the number of CPUs being limited to the cores in the machine. The same architectural principles for scaling apply to cloud servers as physical ones, once you go beyond individual server limits.

Incidentally one aspect this won't apply to in any 'real' cloud (I know, sorry.....) is the disk space - 'real' clouds use shared storage rather than the in-server disks.

__________________
Advania Thor Data Centre Iceland - www.thordc.com
High Spec Colocation and Dedicated Servers, powered by cheap, abundant and 100% renewable energy.
Enterprise grade hosting, ISO27001 accredited for security, and all at fantastic pricing.

brian.rae@thordc.com

  #3  
Old
Newbie
 
Join Date: Nov 2010
Posts: 17
Quote:
Originally Posted by saki2fifty View Post
I have 2 servers each with 128 megs of ram within my cloud and I have one client who has purchased 128 megs of RAM for just one of his hugemongous VM's using all resources on one of the servers, and then decides to "scale" to use more ram, say 256MB
I actually meant Gigs of RAM but the question still applies whether its gigs or other.

Sponsored Links
  #4  
Old
WHT Addict
 
Join Date: Mar 2012
Posts: 162
Some cloud hosts can support live migrations, which means moving a VM to another host without stopping it - essentially no downtime. This is only possible with network storage. The guest OS cannot see memory that is added without a reboot, but it is possible to allocate more memory than a single host actually has, and memory ballooning let's the guest VM see all the memory even though it is consumed and unavailable until the guest moves.

  #5  
Old
Newbie
 
Join Date: Nov 2010
Posts: 17
I just looked up what you just mentioned regarding Vertical / Horizontal scaling, and it describes it in much the same way.

Quote:
Incidentally one aspect this won't apply to in any 'real' cloud (I know, sorry.....) is the disk space - 'real' clouds use shared storage rather than the in-server disks.
I'm looking at examples of a cloud infrastructure, and it looks like you have a couple of options. One is having a dedicated storage server, which I guess is what you are referring to and will limit its IO (??) because now it travelling over wire (??), and the other way (at least with CloudStack) is to define storage locally to the management server itself, which could use the HDD's full potential, maybe? Other than the disk IO and a complex setup, I dont see why you wouldn't use a cloud.

I just bought 4 cheap laptops and setting it up as a cloud for testing to educate myself... I know, I could do the same with some VM's but they were cheap.

  #6  
Old
Newbie
 
Join Date: Apr 2012
Posts: 10
saki, on ebay i buy 6 server erally cheap i spense almost 3000$ but i buy for enterprise server in 300$ reallys server with dual xeon, ecc memori and more features. why u dont see that option? is more reliable than this laptop.. because server have full integration vmx.. laptop not...

  #7  
Old
Web Hosting Master
 
Join Date: Jan 2011
Location: UK
Posts: 776
Quote:
Originally Posted by saki2fifty View Post
I'm looking at examples of a cloud infrastructure, and it looks like you have a couple of options. One is having a dedicated storage server, which I guess is what you are referring to and will limit its IO (??) because now it travelling over wire (??), and the other way (at least with CloudStack) is to define storage locally to the management server itself, which could use the HDD's full potential, maybe? Other than the disk IO and a complex setup, I dont see why you wouldn't use a cloud.
I really meant a SAN rather than a storage server, but in principle the it's the same, just bigger, faster and more reliable. You're right that the shared nature of such storage is often the limiting performance factor of cloud services, similar to the fact that the disk i/o is often the limiting factor for a single virtualised server hosting VPSs. You can indeed use local HDD storage (which will be cheaper) but you lose the resilience which shared storage gives you and to me is one of the most attractive things about cloud.

Quote:
I just bought 4 cheap laptops and setting it up as a cloud for testing to educate myself... I know, I could do the same with some VM's but they were cheap.
Have fun!

__________________
Advania Thor Data Centre Iceland - www.thordc.com
High Spec Colocation and Dedicated Servers, powered by cheap, abundant and 100% renewable energy.
Enterprise grade hosting, ISO27001 accredited for security, and all at fantastic pricing.

brian.rae@thordc.com

  #8  
Old
unghhh... Baaandwidth....
 
Join Date: Jan 2005
Posts: 9,188
Quote:
Originally Posted by Brian_R View Post
I really meant a SAN rather than a storage server, but in principle the it's the same, just bigger, faster and more reliable. You're right that the shared nature of such storage is often the limiting performance factor of cloud services, similar to the fact that the disk i/o is often the limiting factor for a single virtualised server hosting VPSs. You can indeed use local HDD storage (which will be cheaper) but you lose the resilience which shared storage gives you and to me is one of the most attractive things about cloud.



Have fun!
Definitely agree with you. A "cloud" with on-disk non-shared storage is just an expensive VPS, nothing more. Cloud only gets interesting when you can move your installation easily from one node to another, which requires shared storage of some form or another.

__________________
IOFLOOD.com -- We Love Servers
High ram servers with lots of IPs back in stock.
Email: sales [at] ioflood.com
Skype: funkywizard

  #9  
Old
WHT Addict
 
Join Date: Feb 2012
Posts: 105
Are we talking about Cloud spun servers or physical dedicated servers and scaling these? It seems as maybe the OP's lead off was hinting towards them looking at the two examples as physical hard disks. Cloud scaling works on a massive pooling of pure database(s) driven resources harnessed into one singular massive instance (going long here) and virtual servers instances and other services are chunked off as needed or requested, and via templates are dished out as pre determined configurations based upon allocated ram and disk space requested.

Essentially the same, but not, as how some disk partitioners will allow you the ability to re-size a partition which takes up only half the space of an entire physical disk while the disk is in use, vise versa if the partition covers the entire disk but only contains data on 50% of the disk.

Leaving out aspects of virtual memory and further pooling of resources via networking, maybe Cloud load balancing is what the OP is hinting towards?

__________________
You Can't Always Get What You Want
Mick Jagger, Rolling Stones: 1969~Let It Bleed
Cloud to Web Development Design & Deployment and of course, hosting of Cloud services:
VaporCreations.com


Last edited by VaporCreations; 05-06-2012 at 06:07 PM.
  #10  
Old
unghhh... Baaandwidth....
 
Join Date: Jan 2005
Posts: 9,188
Quote:
Originally Posted by VaporCreations View Post
Are we talking about Cloud spun servers or physical dedicated servers and scaling these? It seems as maybe the OP's lead off was hinting towards them looking at the two examples as physical hard disks. Cloud scaling works on a massive pooling of pure database(s) driven resources harnessed into one singular massive instance (going long here) and virtual servers instances and other services are chunked off as needed or requested, and via templates are dished out as pre determined configurations based upon allocated ram and disk space requested.

Essentially the same, but not, as how some disk partitioners will allow you the ability to re-size a partition which takes up only half the space of an entire physical disk while the disk is in use, vise versa if the partition covers the entire disk but only contains data on 50% of the disk.

Leaving out aspects of virtual memory and further pooling of resources via networking, maybe Cloud load balancing is what the OP is hinting towards?
Disk is always easier to scale than ram / cpu. I'm not aware of any cloud implementation that allows one operating system to operate, transparent to the software running on that OS, as though the resources of multiple servers are actually part of one physical device. So long as that limitation exists, there will be a limit to scaling in the cloud in the way in which the OP is asking about. I.E. sure you can scale your 1gb cloud node up to 72gb and 12 cores, but because that's the entire size of the largest physical server the cloud operator happens to offer, to scale past that you must scale in exactly the same way as if you had multiple physical servers: split up the workload across two separate machines, running two separate OS's, and make sure some software is in place that the data each server needs is accessible and in sync with all of the other servers, and that tasks and workloads are split in an even and efficient manner. For some workloads scaling out to multiple machines is trivially easy, and for others, nearly impossible. More common are situations somewhere in the middle, where you can, without a terrible amount of effort, scale to a handful of machines, but certainly not automatically and certainly not without having considered how exactly you plan to physically do the scaling.

__________________
IOFLOOD.com -- We Love Servers
High ram servers with lots of IPs back in stock.
Email: sales [at] ioflood.com
Skype: funkywizard

  #11  
Old
WHT Addict
 
Join Date: Feb 2012
Posts: 105
Ahhh, 10-4. I get what it is that this thread was getting at. Yes.

Yep, you can only split the cookie up so many times and datacenters providing on a Cloud based level can have only so many reserves to back up the reserves that backup the core.


Quote:
I'm not aware of any cloud implementation that allows one operating system to operate, transparent to the software running on that OS, as though the resources of multiple servers are actually part of one physical device.
Although in someways it has to be considered an operating system, but I recall stateless computing being the term of choice which best describes what occurs in a Cloud data center.

An environment where a virtual node is compared to deflated balloon and filling this balloon to various sizes serves some widget of a purpose. This node balloon can be filled with either helium, oxygen, acetylene or what ever (referencing to flavors of OS's). If you only need your balloon filled so much, let's say half, then you still have room to scale it up or down. Once the balloon serves its purpose it can then be deflated for use later, but all the while this balloon has a point which it will burst if filled too full. Bad I know.

Rest assured that a mortal man will never have sole access to the entire bag of balloons. Although that would cool just to clock and watch some assume 3/d renderings, but thanks to the efforts of Google and the PCI Data Security Standard regular guys and gals will only have access to those balloons that were made thick and hard to fill.

__________________
You Can't Always Get What You Want
Mick Jagger, Rolling Stones: 1969~Let It Bleed
Cloud to Web Development Design & Deployment and of course, hosting of Cloud services:
VaporCreations.com


Last edited by VaporCreations; 05-07-2012 at 01:39 AM.
  #12  
Old
Newbie
 
Join Date: Apr 2012
Posts: 10
good explain with balloon xD... but remember, 1 room can get another room toghter.. i explain i have 1 house, 1 room are for multiple ballons or 1 ballons alone, but sometime can make more and more bigger and need another room.. but need to move or another big room, or create another room, but never expand over your house. i explain?

house (server)
room ( virtual machine)

btw i can copy your explain to my web page? i love it!

  #13  
Old
Web Hosting Master
 
Join Date: Jan 2011
Location: Canada
Posts: 934
Quote:
Originally Posted by funkywizard View Post
Definitely agree with you. A "cloud" with on-disk non-shared storage is just an expensive VPS, nothing more. Cloud only gets interesting when you can move your installation easily from one node to another, which requires shared storage of some form or another.
Rackspace had a odd one in terms of scaling. Normally, I wouldn't call their disk 'shared', but once you start a scale, it starts a replication job at the block level. While things are written to the live node, they too get replicated. When the job is done, the two are are swapped and you can accept or revert.

From the provisioning aspect, I still call them a cloud. But I know most people here would rather call it just a VPS because of its topology.

  #14  
Old
Web Hosting Master
 
Join Date: Apr 2002
Location: Seattle, WA
Posts: 947
Generally speaking, life becomes a little easier when you can scale out and not scale up. It's application dependent of course, but once you hit it, it's a good thing.

That's the true "win" in cloud, is when you stop caring about any single server, because you're scaled out across a bunch of generic instances.

__________________
I <3 Linux Clusters

  #15  
Old
Retired Moderator
 
Join Date: May 2006
Location: San Francisco
Posts: 7,188
Quote:
Originally Posted by x86brandon View Post
That's the true "win" in cloud, is when you stop caring about any single server, because you're scaled out across a bunch of generic instances.
Precisely... and that's how you get real abstraction of the technology layer.

Reply

Similar Threads
Thread Thread Starter Forum Replies Last Post
HostPlate.com((NL)-"1Gbps 100TB" "100Mbps Unmetered","Dual Core" &"Quad Core"From 30 navidos Dedicated Hosting Offers 0 01-06-2012 11:33 AM

Related posts from TheWhir.com
Title Type Date Posted
Rackspace Launches Automatic Cloud Scaling Capabilities Web Hosting News 2013-11-21 12:07:13
PHP And MySQL Scaling: Preparing A Startup For Growth Blog 2014-04-24 13:27:35
INetU Adds Dynamic Virtual Scaling to Simplify Managed Cloud Hosting Web Hosting News 2013-07-15 12:05:05
HybridCluster Details Super Dense Auto-Scaling Platform Features Web Hosting News 2013-05-28 16:59:20
Jelastic Introduces Pricing Model with Autoscaling, Volume Discounts Web Hosting News 2013-03-20 15:50:25


Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes
Postbit Selector

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off

Forum Jump
Login:
Log in with your username and password
Username:
Password:



Forgot Password?
WHT Host Brief Email:

We respect your privacy. We will never sell, rent, or give away your address to any outside party, ever.

Advertisement:
Web Hosting News:
WHT Membership
WHT Membership



 

X

Welcome to WebHostingTalk.com

Create your username to jump into the discussion!

WebHostingTalk.com is the largest, most influentual web hosting community on the Internet. Join us by filling in the form below.


(4 digit year)

Already a member?