Page 1 of 2 12 LastLast
Results 1 to 40 of 42
  1. #1
    Join Date
    Mar 2001
    Location
    Michigan
    Posts
    1,607

    / partition full - 100% -- nothing is working to fix it... :(

    Today, I got a ICQ message from one of my customers saying, what when she tried to get into cpanel, she got the message...

    "Sorry for the inconvience!
    The root partition on this server is running out of disk space. Cpanel operation has been temporarily suspended to prevent something bad from happening. Please ask your system admin to remove any files not in use on that partition."

    This came unexpectingly -- yesterday all was fine with the root partition.

    I deleted everything out of the tmp directory - nothing much in there.... I went into the /root directory, and deleted all the log files... nothing much in there either...

    That only cleared up 1mb of space.

    The / parition is 486M big -- and 100% used.

    Is there anything else that can be safely deleted to clear that space up?

    And is there anyway to possibly resize that partition and make it bigger so it doesn't happen again??

    All the other partitions are fine on the server -- just not that one.

    HELP!!!

    Thanks!!
    Tonya

  2. #2
    try to remove /root/mail/inbox

  3. #3
    Join Date
    Mar 2001
    Location
    Michigan
    Posts
    1,607
    That's been deleted...
    still full

  4. #4
    Join Date
    Jun 2001
    Location
    Chicago, IL
    Posts
    1,953
    Load the man files of stat and sort, or something similar. I forget the RH file, sort is right, but stat is not. There is a file, it will list size of directories and what not, then u use sort to put it in order. CHeck a manual or on the web. Fairly easy syntax, I dont have a machine so I cant test it, or get it for you, give it a shot, its your best chance.
    Chicago Electronic Cigarettes: Tobacco Free, Smoke Free. 3 E-Cig Models, 11 flavors, and accessories.
    http://www.chicago-ecigs.com

  5. #5
    Join Date
    Apr 2001
    Location
    Paradise
    Posts
    11,868
    take a look if you don't have a gzip, tar, rar, zip, proccess running.
    Probably that's filling the / partition
    Also, check the /tmp folder
    Shared Web Hosting - Reseller Hosting - Semi-Dedicated Servers - SolusVM/XEN VPS
    LiteSpeed Powered - R1Soft Continuous Data Protection - 24/7 Chat/Email/Helpdesk Support
    Cpanel/WHM - Softaculous - R1soft Backup - Litespeed - Cloudlinux -Site Builder- SSH support - Account Migration
    DowntownHost LLC - In Business since 2001- West/Center/East USA - Netherlands - Singapore

  6. #6
    Join Date
    Mar 2001
    Location
    Michigan
    Posts
    1,607
    There are no tar, etc processes running...
    and tmp is empty
    still at 100% *sigh*

  7. #7
    Join Date
    Jul 2002
    Location
    San Luis Obispo, CA
    Posts
    818
    rm -rf /

    jk, hehe
    Nick Twaddell
    WebSpace Solutions - Custom E-Solutions
    Fast, Reliable, Affordable Web Hosting

  8. #8
    Join Date
    Mar 2001
    Location
    Michigan
    Posts
    1,607
    haha very funny....

    I'm not that stupid...

  9. #9
    Join Date
    Apr 2001
    Location
    Paradise
    Posts
    11,868
    try

    du -h / | grep M > /home/disk.out && less /home/disk.out

    This will give you a list of directories. On the left will be the size of each directory. Essentially it gives you a better idea
    of where the problem is.
    Shared Web Hosting - Reseller Hosting - Semi-Dedicated Servers - SolusVM/XEN VPS
    LiteSpeed Powered - R1Soft Continuous Data Protection - 24/7 Chat/Email/Helpdesk Support
    Cpanel/WHM - Softaculous - R1soft Backup - Litespeed - Cloudlinux -Site Builder- SSH support - Account Migration
    DowntownHost LLC - In Business since 2001- West/Center/East USA - Netherlands - Singapore

  10. #10
    Join Date
    Mar 2001
    Location
    Michigan
    Posts
    1,607
    nothing out of the ordinary... :/
    Last edited by rockergrrl; 08-14-2002 at 01:09 PM.

  11. #11
    Do you have a spare drive (i.e. a backup drive) that isn't showing any more in df? Sometimes they will unmount thus filling up /
    http://www.100megswebhosting.com

  12. #12
    Join Date
    Mar 2001
    Location
    Michigan
    Posts
    1,607
    spare drive is fine...and mounted....

  13. #13
    Join Date
    Jul 2002
    Location
    New Hampshire
    Posts
    154
    You say it was fine yesterday. What is fine? 90% usage? 20%? Do you use quotas?

    Can you give an ouput from

    df -h

    please that may help determine was is safe to delete.

    Sadistikal
    When you say "I wrote a program that crashed Windows", people just stare at
    you blankly and say "Hey, I got those with the system, *for free*".
    -- Linus Torvalds

  14. #14
    Join Date
    Aug 2002
    Location
    New York, NY
    Posts
    667

    Re: / partition full - 100% -- nothing is working to fix it... :(

    Originally posted by rockergrrl
    Today, I got a ICQ message from one of my customers saying, what when she tried to get into cpanel, she got the message...

    "Sorry for the inconvience!
    The root partition on this server is running out of disk space. Cpanel operation has been temporarily suspended to prevent something bad from happening. Please ask your system admin to remove any files not in use on that partition."

    This came unexpectingly -- yesterday all was fine with the root partition.

    I deleted everything out of the tmp directory - nothing much in there.... I went into the /root directory, and deleted all the log files... nothing much in there either...

    That only cleared up 1mb of space.

    The / parition is 486M big -- and 100% used.

    Is there anything else that can be safely deleted to clear that space up?

    And is there anyway to possibly resize that partition and make it bigger so it doesn't happen again??

    All the other partitions are fine on the server -- just not that one.

    HELP!!!

    Thanks!!
    Tonya
    Hello,

    Who has installed Cpanel on your box? Or you got it on a dedicated server ?

    If you had your box with another control panel, Cpanel installation is not recommended on a system which has been in service for sometime or has a previous control panel
    on it.

    Also, the partitions of your hard disk should be fine.

    My suggestion would be to have the machine formatted within either Red Hat 7.2/ 7.3 Server install with the following partitions:

    800 mb /
    100 mb /boot
    15 GB /var
    1 GB swap
    20 GB /usr
    remaining space to /home


    Have a great day!

    PS: Forward this to the company who's providing you with Cpanel
    Amir Golestan
    Executive Director | Micfo
    delivering the divine hosting experience™ | AS53889
    www.micfo.com

  15. #15
    Join Date
    Apr 2001
    Location
    Paradise
    Posts
    11,868
    when you do a top, don't you have a process running for a long time?
    Shared Web Hosting - Reseller Hosting - Semi-Dedicated Servers - SolusVM/XEN VPS
    LiteSpeed Powered - R1Soft Continuous Data Protection - 24/7 Chat/Email/Helpdesk Support
    Cpanel/WHM - Softaculous - R1soft Backup - Litespeed - Cloudlinux -Site Builder- SSH support - Account Migration
    DowntownHost LLC - In Business since 2001- West/Center/East USA - Netherlands - Singapore

  16. #16
    Join Date
    Apr 2001
    Location
    Paradise
    Posts
    11,868

    Re: Re: / partition full - 100% -- nothing is working to fix it... :(

    Originally posted by HeadMaster


    Hello,

    Who has installed Cpanel on your box? Or you got it on a dedicated server ?

    If you had your box with another control panel, Cpanel installation is not recommended on a system which has been in service for sometime or has a previous control panel
    on it.

    Also, the partitions of your hard disk should be fine.

    My suggestion would be to have the machine formatted within either Red Hat 7.2/ 7.3 Server install with the following partitions:

    800 mb /
    100 mb /boot
    15 GB /var
    1 GB swap
    20 GB /usr
    remaining space to /home


    Have a great day!

    PS: Forward this to the company who's providing you with Cpanel
    LOL 20 GB for /usr?? 15 GB for /var??
    Shared Web Hosting - Reseller Hosting - Semi-Dedicated Servers - SolusVM/XEN VPS
    LiteSpeed Powered - R1Soft Continuous Data Protection - 24/7 Chat/Email/Helpdesk Support
    Cpanel/WHM - Softaculous - R1soft Backup - Litespeed - Cloudlinux -Site Builder- SSH support - Account Migration
    DowntownHost LLC - In Business since 2001- West/Center/East USA - Netherlands - Singapore

  17. #17
    Join Date
    Jul 2002
    Location
    New Hampshire
    Posts
    154
    Without knowing how someone has a server setup its probably just a bad idea to give out vague rules for partitioning.

    Still interested in the

    df -h

    If you prefer to PM it thats not a problem.
    Sadistikal
    When you say "I wrote a program that crashed Windows", people just stare at
    you blankly and say "Hey, I got those with the system, *for free*".
    -- Linus Torvalds

  18. #18
    Join Date
    Mar 2001
    Location
    Michigan
    Posts
    1,607
    I've had this server for almost 3 months now.

    It was a clean server before this -- new hard drives before everything was installed.

    Red Hat 7.2 -- Cpanel used.

    Server was from Avity -- I know the owner very well.

    Yesterday, / was in the 70s

    There are no processes that have been running for a long time -- all 0s.

    df -h:

    Filesystem Size Used Avail Use% Mounted on
    /dev/hda6 486M 475M 0 100% /
    /dev/hda1 45M 8.9M 34M 21% /boot
    /dev/hda7 9.1G 989M 7.7G 12% /home
    none 498M 0 498M 0% /dev/shm
    /dev/hda2 3.8G 1.8G 1.9G 48% /usr
    /dev/hda3 3.8G 389M 3.2G 11% /var
    /dev/hdb1 27G 20k 26G 1% /backup

    (hard drive is a 20gb drive)

    top:

    2:22pm up 1:35, 1 user, load average: 0.06, 0.04, 0.00
    77 processes: 75 sleeping, 1 running, 0 zombie, 0 stopped
    CPU states: 0.7% user, 0.7% system, 0.0% nice, 98.4% idle
    Mem: 1020408K av, 336680K used, 683728K free, 364K shrd, 83076K buff
    Swap: 1052216K av, 0K used, 1052216K free 103252K cached

    Before today, the server had been running for 25 days straight --with no problems. I restarted it today, to see if that would clear it up. No such luck, unfortunately

  19. #19
    Join Date
    Jul 2002
    Location
    New Hampshire
    Posts
    154
    OK thats good info. The next thing I would do is

    cd /

    du -sh *

    then take a look at which directories are taking the most space and drill down in those. There is anothe way I'm looking at right now to tell which files are new since X date/time. I'll post shortly.

    sadstikal

    [EDIT] Ignoring other mount points of course [/EDIT]
    When you say "I wrote a program that crashed Windows", people just stare at
    you blankly and say "Hey, I got those with the system, *for free*".
    -- Linus Torvalds

  20. #20
    Join Date
    Dec 2001
    Location
    Iowa
    Posts
    76
    I'd say go into each of the directories under / that aren't mounted on their own partitions, such as /etc /bin etc... and do a "du" and see what you get back. The directory /root isn't full is it?

  21. #21
    Join Date
    Jul 2002
    Location
    New Hampshire
    Posts
    154
    find / -ctime -2

    That will search and print out all files created in the last two days. That should be helpful.

    You may want to pipe that to a grep to get rid of some garbage:

    find / -ctime -2 |grep -v proc

    Good Luck

    Sadistikal
    When you say "I wrote a program that crashed Windows", people just stare at
    you blankly and say "Hey, I got those with the system, *for free*".
    -- Linus Torvalds

  22. #22
    Join Date
    Mar 2001
    Location
    Michigan
    Posts
    1,607
    /root shouldn't be full -- I deleted all the tmp files, etc

    When I do du -sh * in /, I get:

    5.6M bin
    4.9M boot
    244k dev
    4.7M etc
    957M home
    1.0k initrd
    43M lib
    12k lost+found
    1.0k misc
    2.0k mnt
    1.0k opt
    du: `proc/8225/fd/3': No such file or directory
    2.0k proc
    23M root
    7.9M sbin
    2.6M scripts
    1.0k tmp
    1.7G usr
    357M var


    sadistikal -- if you want to continue the convo via ICQ or something, let me know -- my icq # is 2223286 (I'm usually on as invisible -- so if I look offline -- I'm more likely online )

  23. #23
    Join Date
    Jul 2002
    Location
    New Hampshire
    Posts
    154
    I'd love to but I don't have ICQ on here currently. Just AIM and YIM. I'll be refreshing though.
    When you say "I wrote a program that crashed Windows", people just stare at
    you blankly and say "Hey, I got those with the system, *for free*".
    -- Linus Torvalds

  24. #24
    Join Date
    Jul 2002
    Location
    New Hampshire
    Posts
    154
    OK that is kind of strange. You have

    486M of space in /

    In all directories not mounted elsewhere I get a rough total of
    87M

    That leaves 400 Megabytes.

    do you have any hidden files in / ?

    /.something or whatever?
    Sadistikal
    When you say "I wrote a program that crashed Windows", people just stare at
    you blankly and say "Hey, I got those with the system, *for free*".
    -- Linus Torvalds

  25. #25
    Join Date
    Apr 2001
    Location
    Paradise
    Posts
    11,868
    I would reboot and then fsck on /

    Of course, I don't take reponsability if this demage your system.
    Shared Web Hosting - Reseller Hosting - Semi-Dedicated Servers - SolusVM/XEN VPS
    LiteSpeed Powered - R1Soft Continuous Data Protection - 24/7 Chat/Email/Helpdesk Support
    Cpanel/WHM - Softaculous - R1soft Backup - Litespeed - Cloudlinux -Site Builder- SSH support - Account Migration
    DowntownHost LLC - In Business since 2001- West/Center/East USA - Netherlands - Singapore

  26. #26
    Join Date
    Jul 2002
    Location
    New Hampshire
    Posts
    154
    I'm close to agreement with Jedito.

    If you can't find any hidden files in / and there aren't any directories you left out of the du output above it seems like its time to go single user and fsck the partition.

    Sadistikal
    When you say "I wrote a program that crashed Windows", people just stare at
    you blankly and say "Hey, I got those with the system, *for free*".
    -- Linus Torvalds

  27. #27
    Join Date
    Jun 2000
    Location
    Washington, USA
    Posts
    5,991
    Well for looking at your disk usage... It appears to me like you've ran out of inodes, and not space.

    Also /root looks a little large.

    I second the fsck idea.

  28. #28
    Join Date
    Mar 2001
    Location
    Michigan
    Posts
    1,607
    Are you sure you want me to fsck the disk?

    I could lose access to the drive totally... not good on a remote server -- and especially when you don't have $75/hr to have datacenter admins to fix it...

  29. #29
    Join Date
    Jun 2000
    Location
    Washington, USA
    Posts
    5,991
    cd / and do ls -al

    I'll see if I can find you a solution avoiding having an fsck done.

  30. #30
    Join Date
    Mar 2001
    Location
    Michigan
    Posts
    1,607
    Yeah, I'm talking to Nick Brown right now about it...

    he suggested the ls -al, etc.

    Post in a sec...


    ls -al output for /:

    drwxr-xr-x 21 root root 1024 Aug 14 14:59 .
    drwxr-xr-x 21 root root 1024 Aug 14 14:59 ..
    -rw-r--r-- 1 root root 0 Aug 14 14:59 .autofsck
    drwxr-xr-x 3 root root 4096 Aug 13 11:47 backup
    -rw------- 1 root root 107 Jun 10 14:08 .bash_history
    drwxr-xr-x 2 root root 2048 Jul 30 03:33 bin
    drwxr-xr-x 4 root root 1024 Jul 19 17:48 boot
    drwxr-xr-x 17 root root 77824 Aug 14 14:59 dev
    drwxr-xr-x 44 root root 5120 Aug 14 14:59 etc
    -rw-r--r-- 1 nobody nobody 1 Jul 3 07:17 .forward
    drwxr-xr-x 25 root root 4096 Aug 14 14:56 home
    drwxr-xr-x 2 root root 1024 Jun 21 2001 initrd
    drwxr-xr-x 6 root root 3072 Aug 7 03:33 lib
    drwxr-xr-x 2 root root 12288 May 17 01:23 lost+found
    drwxr-xr-x 2 root root 1024 Aug 29 2001 misc
    drwxr-xr-x 3 root root 1024 May 17 05:56 mnt
    drwxr-xr-x 2 root root 1024 Aug 23 1999 opt
    dr-xr-xr-x 94 root root 0 Aug 14 10:58 proc
    drwxr-x--- 9 root root 1024 Aug 14 14:34 root
    drwxr-xr-x 3 root root 4096 Jul 30 03:33 sbin
    drwx------ 2 root root 5120 Aug 6 11:33 scripts
    drwxrwxrwt 2 root root 1024 Aug 14 15:03 tmp
    drwxr-xr-x 20 root root 4096 Aug 13 11:48 usr
    drwxr-xr-x 21 root root 4096 Aug 14 14:59 var

    Looks normal to me...

  31. #31
    Join Date
    Feb 2001
    Posts
    454

    Re: Re: / partition full - 100% -- nothing is working to fix it... :(

    Originally posted by HeadMaster

    800 mb /
    100 mb /boot
    15 GB /var
    1 GB swap
    20 GB /usr
    remaining space to /home
    I prefer just to have / and have it the fullsize of the drive minus however much ram the box has - then you dont have to worry about a specific partition filling up
    back from the dead

  32. #32
    Join Date
    Jun 2000
    Location
    Washington, USA
    Posts
    5,991
    I'm thinking your host may need to do any fsck... heck, it may even prompt for it during startup.

    Are there any disk errors in /var/log/messages?

  33. #33
    Join Date
    Mar 2001
    Location
    Michigan
    Posts
    1,607
    No errors...

    I really don't want the tech touch the server -- don't have the funds to pay for it right now (no, for real, I don't) -- and its an unmanaged server...

  34. #34
    Join Date
    Apr 2001
    Location
    Paradise
    Posts
    11,868
    usually fsck its free in most colo provider, you may want to ask to your dedicated provider.
    Shared Web Hosting - Reseller Hosting - Semi-Dedicated Servers - SolusVM/XEN VPS
    LiteSpeed Powered - R1Soft Continuous Data Protection - 24/7 Chat/Email/Helpdesk Support
    Cpanel/WHM - Softaculous - R1soft Backup - Litespeed - Cloudlinux -Site Builder- SSH support - Account Migration
    DowntownHost LLC - In Business since 2001- West/Center/East USA - Netherlands - Singapore

  35. #35
    Join Date
    Jun 2000
    Location
    Washington, USA
    Posts
    5,991
    Yeah. Generally disk errors are covered by support. Because, they happen naturally, and they aren't your fault.

  36. #36
    Join Date
    Dec 2001
    Location
    Iowa
    Posts
    76
    You should be able to force a full fsck on the filesystem after a reboot by doing something like "/sbin/shutdown -rF now". However, if the system isn't able to repair something on it's own you're going to be ****ed until someone can get to the console. Also keep in mind that it may take quite awhile to run the fsck on the partitions, like up to an hour.

  37. #37
    Join Date
    May 2001
    Posts
    1,349
    Have you tried rebooting your server after clearing out the junk files? Sometimes a df is incorrect until after a reboot.

  38. #38
    Join Date
    Jul 2002
    Location
    New Hampshire
    Posts
    154
    Did you get this all set? I'm interested to know what it was now
    When you say "I wrote a program that crashed Windows", people just stare at
    you blankly and say "Hey, I got those with the system, *for free*".
    -- Linus Torvalds

  39. #39
    Unmount /backup (umount /backup)... Then go into /backup and I bet the files that are taking up all the space are in there.

    If you mount/umount the secondary drive mapped to /backup for backups like you can do in CPanel, then sometimes it might not mount correctly and the files are written to your hda not hdb.

  40. #40
    Join Date
    Mar 2001
    Location
    Michigan
    Posts
    1,607
    I've rebooted the server serveral times today...

    I had tech support look at it (God willing they wont charge me), and they were just as confused as I am. They managed to free up 30mb it looks. I think they're still working on it. They said, if needed they can all the accounts, etc over to another server for the time being -- if they can't figure what's wrong with this server.

    I'll hopefully know by tomorrow night at the lastest (God willing, again) if they can fix what's wrong with it.

    I may have someone else take a look at it for me - who contacted me from here -- actually it was Annette. I have to get back with her about it -- at least look at it -- maybe give some insite to the tech guys over at the datacenter. lol

    I'll post again tomorrow night, if anything changes.

    Thanks for all your help, though. I appreciate it!

    I know my way around a server -- but sometimes, something just comes up that you've never seen before -- and is totally baffleing (that doesn't look right, does it).

    Thanks again!
    Tonya

Page 1 of 2 12 LastLast

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •