Results 1 to 11 of 11
  1. #1
    Join Date
    Jan 2008
    Location
    St. John's, NL
    Posts
    2,201

    Find out why CentOS/cPanel server went down

    Hi guys,

    What are the ways to find out why a CentOS 5.3 server running cPanel suddenly went offline.

    I ran "last reboot -n 10" and "last" and grepped for shutdown calls, but nothing. /var/log/messages.1 reveals nothing as well.

    Any suggestions?
    Last edited by larwilliams; 07-14-2009 at 01:55 PM.
    Cpanel/WHM • PHP • Perl • Ruby • Full Time Support
    LCWSoft - Canada web hosting (based in Newfoundland) since 2007
    Servers based in the US and Canada (Uptime Report)

  2. #2
    Williams,

    Just grep for the time the server went down in /var/log/messages.

    This will provided you information on which was the last call and how it got shut down.

  3. #3
    Join Date
    Jan 2008
    Location
    St. John's, NL
    Posts
    2,201
    Say it went down between 1:50 and 3:00pm, how would i grep that?
    Cpanel/WHM • PHP • Perl • Ruby • Full Time Support
    LCWSoft - Canada web hosting (based in Newfoundland) since 2007
    Servers based in the US and Canada (Uptime Report)

  4. #4
    Join Date
    May 2009
    Location
    SLASH ROOT
    Posts
    867
    any error messages in the kernel buffers?

    Check the dmesg output or /var/log/dmesg

    Where there any scheduled tasks, like backups, when the server went down?
    █ WebHostRepo.com
    █ Linux | Windows
    | VPS | Cloud
    █ Outsourced Technical Support since 2009
    █ sales@webhostrepo.com

  5. #5
    Join Date
    Oct 2007
    Location
    India
    Posts
    68
    Hello ,

    1. First of all ensure that it was not an issue from the DC due to
    any power fluctuations ( it happens with some )
    2. Second check /var/log/messages for any issues , try to grep reboot , shutdown e.t.c .
    3. Ask DC if any hardware failure is noted , primarily RAM .
    4. Monitor your server for some time using top , free -m e.t.c in
    different terminals and see if any PIDS are taking excessive memory resources . if noticed go to cd /proc/PIDNUMBER/ and do an
    ll to see what is causing the issue.
    5 . DO a dmesg to check if any hardisk failure is there .
    Regards,
    Alan John

  6. #6
    Join Date
    Jan 2008
    Location
    St. John's, NL
    Posts
    2,201
    Quote Originally Posted by whrss View Post
    any error messages in the kernel buffers?

    Check the dmesg output or /var/log/dmesg

    Where there any scheduled tasks, like backups, when the server went down?
    I grepped /var/log/dmesg for "fail", "warn", and "error", but came up empty.

    The cron logs show nothing unusual as well.
    Cpanel/WHM • PHP • Perl • Ruby • Full Time Support
    LCWSoft - Canada web hosting (based in Newfoundland) since 2007
    Servers based in the US and Canada (Uptime Report)

  7. #7
    Join Date
    Oct 2004
    Location
    Kerala, India
    Posts
    4,771
    Quote Originally Posted by larwilliams View Post
    Say it went down between 1:50 and 3:00pm, how would i grep that?
    Use the following command to get the messages.

    Assuming the date is Jul 14 and logs between 1pm and 3pm server time.

    Code:
    sed -n '/Jul 14 13:/,/Jul 14 15:/p' /var/log/messages
    David | www.cliffsupport.com
    Affordable Server Management Solutions sales AT cliffsupport DOT com
    CliffWebManager | Access WHM from iPhone and Android

  8. #8
    Join Date
    Jan 2008
    Location
    St. John's, NL
    Posts
    2,201
    Quote Originally Posted by david510 View Post
    Use the following command to get the messages.

    Assuming the date is Jul 14 and logs between 1pm and 3pm server time.

    Code:
    sed -n '/Jul 14 13:/,/Jul 14 15:/p' /var/log/messages
    Thank you I think I was able to track down the issue because of the above:

    Code:
    Jul 14 14:40:29 athena pure-ftpd: (?@127.0.0.1) [INFO] __cpanel__service__auth__ftpd__kP9jFQpsOhi3GwXDulkQdUZxWtPcmmIqBfDoaE6JZVmvpEd9Kr3RdRFkapRZxkfy is now logged in
    Jul 14 14:40:29 athena kernel: eth0: PCI Bus error a290.
    Jul 14 14:40:29 athena kernel: eth0: PCI Bus error 8139.
    Jul 14 14:56:58 athena syslogd 1.4.1: restart.
    Jul 14 14:56:58 athena kernel: klogd 1.4.1, log source = /proc/kmsg started.
    Jul 14 14:56:58 athena kernel: Linux version 2.6.18-128.1.16.el5 (mockbuild@builder10.centos.org) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-44)) #1 SMP Tue Jun 30 06:07:26 EDT 2009
    Jul 14 14:56:58 athena kernel: Command line: ro root=/dev/VolGroup00/LogVol00
    Something with the NIC it seems. Any ideas? A google revealed nothing.
    Cpanel/WHM • PHP • Perl • Ruby • Full Time Support
    LCWSoft - Canada web hosting (based in Newfoundland) since 2007
    Servers based in the US and Canada (Uptime Report)

  9. #9
    Join Date
    Oct 2004
    Location
    Kerala, India
    Posts
    4,771
    Yes this seems to be a HW error. Have a check of it.
    David | www.cliffsupport.com
    Affordable Server Management Solutions sales AT cliffsupport DOT com
    CliffWebManager | Access WHM from iPhone and Android

  10. #10
    Join Date
    Jan 2008
    Location
    St. John's, NL
    Posts
    2,201
    I had the data center replace the NIC. We will see how that goes.
    Cpanel/WHM • PHP • Perl • Ruby • Full Time Support
    LCWSoft - Canada web hosting (based in Newfoundland) since 2007
    Servers based in the US and Canada (Uptime Report)

  11. #11
    Join Date
    May 2009
    Location
    SLASH ROOT
    Posts
    867
    If the issue recurs, have your DC check the NIC drivers as well.
    █ WebHostRepo.com
    █ Linux | Windows
    | VPS | Cloud
    █ Outsourced Technical Support since 2009
    █ sales@webhostrepo.com

Similar Threads

  1. services failing on cpanel/centos server
    By igrowyourbiz in forum Systems Management Requests
    Replies: 9
    Last Post: 09-22-2008, 12:49 PM
  2. install htop on cPanel CentOS server?
    By dinsolglobal in forum Hosting Security and Technology
    Replies: 4
    Last Post: 06-25-2008, 11:49 AM
  3. can centos 32 bits (with cpanel) detect server 8GB RAM
    By swijaya0101 in forum Dedicated Server
    Replies: 6
    Last Post: 05-11-2006, 11:52 AM
  4. Server Hangs on Reboot - CentOS + CPanel
    By VanHost in forum Hosting Security and Technology
    Replies: 5
    Last Post: 01-31-2005, 12:41 PM
  5. CPanel server... CentOS or Fedora 2 ?
    By WWWhost in forum Dedicated Server
    Replies: 17
    Last Post: 11-07-2004, 12:19 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •