Results 1 to 11 of 11
  1. #1

    * High Memory Utilization!!

    Hi everybody,

    I would like to sharing my current bad experience with my server...

    the case is:-

    I have dedicated server for one website contains a vbulletin forum only with more than 600K registered users, the issue is that always the memory is highly utilized (70% - 98%) during low CPU load also with high CPU load, I snapped this info for your review

    load average: 1.20, 1.68, 1.47
    Mem: 2074940k total, 2003464k used, 71476k free, 43640k buffers

    load average: 4.35, 4.06, 2.80
    Mem: 2074940k total, 2040712k used, 34228k free, 11988k buffers

    can anybody here assist my in this confused situation, also what is the mainly reasons that cause high memory utilization in any server.

    Regards,

  2. #2
    Join Date
    Sep 2006
    Location
    AU - NSW
    Posts
    67
    Intersting
    Are you running debian
    Im having the same issue with debian (to the point of considering changing OS's)

  3. #3
    Join Date
    Jun 2004
    Location
    Bay Area
    Posts
    1,320
    I'm no pro on this...but isn't your OS supposed to cache as much to ram as possible?

    If you run 'free -m', it shows this for example:
    PHP Code:
    free -m
                 total       used       free     shared    buffers     cached
    Mem
    :          1003        998          5          0         23        764
    -/+ buffers/cache:        210        793
    Swap
    :         2045        147       1897 
    Which basically means that all my ram is filled up, BUT only 210MB is actually in use. The rest is just caching of files, to improve overall speeds.
    Last edited by Xandrios; 11-24-2006 at 09:24 AM.

  4. #4
    Join Date
    Dec 2002
    Location
    USA
    Posts
    62
    Do you have your database on the same server? 600k users is quite alot.

  5. #5
    Right, give us more details about your server, i will research on it and will surely let you know.

  6. #6
    Quote Originally Posted by underg
    Intersting
    Are you running debian
    Im having the same issue with debian (to the point of considering changing OS's)
    No Sir.

    Quote Originally Posted by Xandrios
    I'm no pro on this...but isn't your OS supposed to cache as much to ram as possible?

    If you run 'free -m', it shows this for example:
    PHP Code:
    free -m
                 total       used       free     shared    buffers     cached
    Mem
    :          1003        998          5          0         23        764
    -/+ buffers/cache:        210        793
    Swap
    :         2045        147       1897 
    Which basically means that all my ram is filled up, BUT only 210MB is actually in use. The rest is just caching of files, to improve overall speeds.
    Sir, am not pro in this too , but for FYI I used that command you provided see this results for your review and update:-

    total used free shared buffers cached
    Mem: 2026 1994 32 0 3 353
    -/+ buffers/cache: 1637 389
    Swap: 4095 1146 2949

    what you think?!

    Quote Originally Posted by Server-Specialist
    run the top command to know what's the matter
    and i can assist you with this issue
    contact me
    top - 00:14:40 up 17 days, 20:23, 1 user, load average: 62.72, 60.60, 36.21
    Tasks: 1106 total, 5 running, 1066 sleeping, 0 stopped, 35 zombie
    Cpu(s): 47.1% us, 11.0% sy, 0.0% ni, 6.2% id, 35.6% wa, 0.0% hi, 0.0% si
    Mem: 2074940k total, 2054664k used, 20276k free, 6332k buffers
    Swap: 4194216k total, 1221544k used, 2972672k free, 345364k cached

    Sir, are you looking for this ?
    please specify what is exactly you concerned

    Quote Originally Posted by jonMEGA
    Do you have your database on the same server? 600k users is quite alot.
    yes we do, what is your recommendations in this part?
    and what is the signs that requiring to move this database to be on separate server?

    Quote Originally Posted by hosting advisor
    Right, give us more details about your server, i will research on it and will surely let you know.
    Sir, what kind of details you looking for? specify please.

  7. #7
    Join Date
    Oct 2005
    Location
    US
    Posts
    308
    It would help if you post the stuff underneath:

    top - 00:14:40 up 17 days, 20:23, 1 user, load average: 62.72, 60.60, 36.21
    Tasks: 1106 total, 5 running, 1066 sleeping, 0 stopped, 35 zombie
    Cpu(s): 47.1% us, 11.0% sy, 0.0% ni, 6.2% id, 35.6% wa, 0.0% hi, 0.0% si
    Mem: 2074940k total, 2054664k used, 20276k free, 6332k buffers
    Swap: 4194216k total, 1221544k used, 2972672k free, 345364k cached

    Since without that we cant see "what" is using the memory. It's definitely not cached.

    You have a high load though.

    Since the load, and memory usage is probably mysql, my recommendation would be a second server strictly to run mysql, with some SCSI drives.
    Last edited by No1Resource; 11-26-2006 at 05:52 PM.

  8. #8
    Join Date
    Apr 2005
    Location
    Oz
    Posts
    3,498
    What are the current specs of this server? It obviously has 2GB of RAM, but what sort of processor, HDD's, etc does it have? Also, who is the provider? Finally, how many users do you normally have online at your forum?

    You may want to look into my.cnf and php/apache optimization to get more out of your server. You might also want to look into getting a second server to act as the database server.


    Alex

  9. #9
    Join Date
    Dec 2002
    Location
    USA
    Posts
    62
    top - 00:14:40 up 17 days, 20:23, 1 user, load average: 62.72, 60.60, 36.21
    Tasks: 1106 total, 5 running, 1066 sleeping, 0 stopped, 35 zombie
    Cpu(s): 47.1% us, 11.0% sy, 0.0% ni, 6.2% id, 35.6% wa, 0.0% hi, 0.0% si
    Mem: 2074940k total, 2054664k used, 20276k free, 6332k buffers
    Swap: 4194216k total, 1221544k used, 2972672k free, 345364k cached
    It looks like you are running out of RAM look at your wa %. This is when the server has to wait for the SWAP to supply it with data or put data in SWAP. I would look to add more RAM in the server and possible install faster hard drives (SCSI).

  10. #10
    Join Date
    Feb 2004
    Location
    here and there
    Posts
    746
    top -s2
    hit 'o'
    type 'size', hit enter.

    What processes are listed up top?

    (ew 1gig of swap usage!)

    Awknet - DDoS Mitigation, Upstream ACLs/Filtering, Unmanaged Dedicated Servers, BGP IP Transit & More!

  11. #11
    Join Date
    Oct 2004
    Location
    Southwest UK
    Posts
    1,159
    Don't forget that Linux uses all the memory it can - so 100% usage is good. Its when it spills over into using swap memory that things need looking at. As yours has 1gig of swap used, you need to look into it.

    I'd say that you have a heavily loaded server - 58% CPU usage doing real work is a lot, the other 38% waiting for IO is just a symptom of running out of RAM. I hope that the load of 60 is just because of the high number of waiting processes, and not because its overloaded.

    I think that, because you have 1000 sleeping processes, the issue is that these are hanging around when they are no longer needed, this suggests that you have persistent connections turned on, then check your connection settings in MySql and httpd - basically you're looking to see that your visitors come, look at the DB, then leave. If you have lengthy timeouts then Mysql/http still thinks they're using it and so stay running (well, sleeping).


    Of course, the other factor is that you have a lot of memory used for the number of visitors you have. Add more and you'll run a lot better. If, once you do this, the load stays high then you'd be best advised to get a new server to place the DB on (get more CPU than RAM for that box, MySQL uses 100x more CPU than httpd)
    Do not meddle in the affairs of Dragons, for you are crunchy and taste good.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •