Hey guys,
For over a month now, we've had issues with our server. Posts, comments and user uploads are often duplicated. I tends to happen a higher % of times during peak hours than off peak. It's mainly user uploads which are duplicated and tend to be much bigger in file size.
Just FYI, I'm a complete novice when it comes to servers and such. So please bear with me.
We have a web server and an SQL server. The host has been focused on the web server and believe if any, that will be the issue. The web server currently has 16GB ram and 2 quad core processors in it. We run Litespeed rather than Apache and also use Nginx for static content.
Last week the server was replaced to remove the possibility that it maybe hardware related. However the issue continued. Tweaks to the web server have helped reduce the number of duplicates but not eliminated it.
When the duplicate uploads occur, the browser reports "Sending data to www.site...." at the bottom left of the browser and then it will change to "waiting for www.site....".
Now if everything is OK the page will send you to your new upload but if it switches from "waiting" to "sending" again that means it's going to duplicate the upload and will continue doing so untill you stop the page. It's as though it's looping. I wondered whether the system was running out of RAM or something.
The site is several years old and the upload script hadn't changed anytime before the issue started. Plus as I say, the forum posts and other things are also sometimes duplicated.
Here is a current snapshot of the top processes.
PHP Code:
top - 15:04:05 up 4 days, 21:22, 0 users, load average: 11.71, 11.11, 10.38
Tasks: 294 total, 1 running, 293 sleeping, 0 stopped, 0 zombie
Cpu(s): 45.3%us, 1.7%sy, 0.0%ni, 52.1%id, 0.2%wa, 0.0%hi, 0.3%si, 0.4%st
Mem: 15728640k total, 15219764k used, 508876k free, 217772k buffers
Swap: 17793016k total, 799640k used, 16993376k free, 10612108k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
29596 nobody 16 0 190m 35m 4912 S 73.8 0.2 0:55.77 lsphp5
31547 nobody 16 0 116m 18m 3692 S 69.9 0.1 0:04.59 lsphp5
19847 nobody 15 0 194m 38m 4988 S 54.4 0.3 4:02.23 lsphp5
17675 nobody 15 0 194m 39m 5016 S 33.0 0.3 12:35.46 lsphp5
31407 nobody 15 0 171m 19m 4004 S 33.0 0.1 0:31.77 lsphp5
29421 nobody 15 0 192m 38m 4892 S 17.5 0.3 1:20.31 lsphp5
29216 nobody 15 0 176m 22m 4516 S 15.5 0.1 0:59.87 lsphp5
13180 nobody 15 0 194m 40m 6284 S 11.7 0.3 6:42.08 lsphp5
23009 nobody 15 0 191m 38m 5028 S 11.7 0.3 3:04.45 lsphp5
31546 nobody 15 0 117m 18m 3764 S 11.7 0.1 0:20.88 lsphp5
32064 nobody 16 0 137m 37m 4572 S 11.7 0.2 0:18.07 lsphp5
29420 nobody 15 0 191m 38m 4800 S 9.7 0.2 0:45.11 lsphp5
26181 nobody 16 0 191m 38m 4836 S 7.8 0.2 1:53.58 lsphp5
30934 nobody 15 0 191m 38m 4856 S 7.8 0.2 1:10.49 lsphp5
2397 nobody 10 -5 23780 8120 1560 S 1.9 0.1 2:18.53 lshttpd
2400 nobody 10 -5 23960 8396 1600 S 1.9 0.1 2:26.21 lshttpd
2402 nobody 10 -5 29384 13m 5472 S 1.9 0.1 10:39.72 lshttpd
30089 nobody 16 0 115m 16m 4552 S 1.9 0.1 1:04.48 lsphp5
And here is the current RAM usage and load
PHP Code:
Current Server Load 11.71
Total Server Memory 15360 MB
Available Physical Memory 492 MB
Not sure if any of that will help diagnose the issue but I'm running out of ideas and the host has failed to pin point the issue, so figured it was worth asking on here.
Many thanks for any leads or advice.
Linear Mode
