Causing my server to crash.
« on: July 01, 2011, 10:55:50 PM »
Ok, this is the second time it happens that the server crashes after running the xml generator. My host has provided me with some information for me to provide you.

------------------START MESSAGE-------------------------------------------------------------

I've reviewed your ticket. It doesn't appear that you were hitting any limits before the restart.
02:10:01 PM runq-sz plist-sz ldavg-1 ldavg-5 ldavg-15
02:20:02 PM 1 230 0.00 0.01 0.00
02:30:01 PM 2 238 0.00 0.00 0.00
02:40:01 PM 2 240 0.01 0.01 0.00
02:50:01 PM 3 271 0.07 0.04 0.00
03:00:01 PM 6 277 0.00 0.00 0.00
03:10:01 PM 1 282 0.00 0.00 0.00
03:20:01 PM 3 285 0.11 0.04 0.01
03:50:01 PM 0 286 0.02 0.01 0.00
Average: 2 181 0.17 0.15 0.12

03:59:38 PM LINUX RESTART
========================================================================================================
02:10:01 PM kbmemfree kbmemused %memused kbbuffers kbcached kbswpfree kbswpused %swpused kbswpcad
02:20:02 PM 338952 447480 56.90 0 0 0 0 0.00 0
02:30:01 PM 306432 480000 61.04 0 0 0 0 0.00 0
02:40:01 PM 275744 510688 64.94 0 0 0 0 0.00 0
02:50:01 PM 243248 543184 69.07 0 0 0 0 0.00 0
03:00:01 PM 212576 573856 72.97 0 0 0 0 0.00 0
03:10:01 PM 182268 604164 76.82 0 0 0 0 0.00 0
03:20:01 PM 153024 633408 80.54 0 0 0 0 0.00 0
03:50:01 PM 134680 651752 82.87 0 0 0 0 0.00 0
Average: 506351 280081 35.61 0 0 0 0 0.00 0

03:59:38 PM LINUX RESTART

based on this you were using at most 80.54% of the memory allocation. We can see that index.php is generating a large number of processes, many of them using duplicate IPs. It's possible that the site map is trying to index all your forum pages as well causing a load spike that causes the forum itself to be unable to allocate resources.....

You may be able to submit this information to the generator developer to illustrate this behaviour. If they would like some other specific information, we can pull it from the snapshot logs. Let us know if there's anything else that we can do to be of assistance.

-------------------END MESSAGE---------------------------------------------------------------

------------------------START ERROR LOG-----------------------------------------------------

ab2168   10028  0.0  1.6 136132 12684 ?        S    14:00   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168    7929  0.0  1.6 136132 12688 ?        S    13:38   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168    9429  0.0  1.6 136132 12688 ?        S    13:48   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   10138  0.0  1.6 136132 12684 ?        S    14:02   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   11346  0.0  1.6 136132 12684 ?        S    14:06   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168    6108  0.0  1.6 136132 12688 ?        S    13:22   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168    7225  0.0  1.6 136132 12688 ?        S    13:24   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168    7298  0.0  1.6 136132 12688 ?        S    13:26   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168    7389  0.0  1.6 136132 12684 ?        S    13:28   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168    7530  0.0  1.6 136132 12688 ?        S    13:30   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168    7622  0.0  1.6 136132 12684 ?        S    13:32   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168    7700  0.0  1.6 136132 12688 ?        S    13:34   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168    7800  0.0  1.6 136132 12688 ?        S    13:36   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168    8058  0.0  1.6 136132 12684 ?        S    13:40   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168    8113  0.0  1.6 136132 12688 ?        S    13:42   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168    9229  0.0  1.6 136132 12688 ?        S    13:44   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168    9346  0.0  1.6 136132 12684 ?        S    13:46   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168    9541  0.0  1.6 136132 12688 ?        S    13:50   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168    9628  0.0  1.6 136132 12684 ?        S    13:52   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168    9750  0.0  1.6 136132 12684 ?        S    13:54   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168    9859  0.0  1.6 136132 12684 ?        S    13:56   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168    9913  0.0  1.6 136132 12684 ?        S    13:58   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   11285  0.0  1.6 136132 12684 ?        S    14:04   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   12127  0.0  1.6 136132 12684 ?        S    14:17   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   16052  0.0  1.6 136132 12688 ?        S    14:47   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   17798  0.0  1.6 136132 12688 ?        S    14:59   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   11886  0.0  1.6 136132 12684 ?        S    14:13   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   11990  0.0  1.6 136132 12684 ?        S    14:15   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   13625  0.0  1.6 136132 12688 ?        S    14:25   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   13743  0.0  1.6 136132 12688 ?        S    14:27   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   19981  0.0  1.6 136132 12688 ?        S    15:19   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   11566  0.0  1.6 136132 12684 ?        S    14:08   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   11744  0.0  1.6 136132 12684 ?        S    14:10   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   12243  0.0  1.6 136132 12684 ?        S    14:19   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   13430  0.0  1.6 136132 12684 ?        S    14:21   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   13490  0.0  1.6 136132 12688 ?        S    14:23   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   13854  0.0  1.6 136132 12688 ?        S    14:29   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   13938  0.0  1.6 136132 12684 ?        S    14:31   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   14077  0.0  1.6 136132 12684 ?        S    14:33   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   14223  0.0  1.6 136132 12684 ?        S    14:35   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   15383  0.0  1.6 136132 12688 ?        S    14:37   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   15485  0.0  1.6 136132 12688 ?        S    14:39   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   15656  0.0  1.6 136132 12684 ?        S    14:41   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   15792  0.0  1.6 136132 12684 ?        S    14:43   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   15923  0.0  1.6 136132 12684 ?        S    14:45   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   17936  0.0  1.6 136132 12688 ?        S    15:01   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   18013  0.0  1.6 136132 12684 ?        S    15:03   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   19790  0.0  1.6 136132 12684 ?        S    15:15   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   20237  0.0  1.6 136132 12688 ?        S    15:23   0:00  |   \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   16187  0.0  1.6 136132 12684 ?        S    14:49   0:00      \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   16328  0.0  1.6 136132 12684 ?        S    14:51   0:00      \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   17474  0.0  1.6 136132 12684 ?        S    14:53   0:00      \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   17558  0.0  1.6 136132 12688 ?        S    14:55   0:00      \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   17669  0.0  1.6 136132 12684 ?        S    14:57   0:00      \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   18148  0.0  1.6 136132 12688 ?        S    15:05   0:00      \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   18259  0.0  1.6 136132 12688 ?        S    15:07   0:00      \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   18410  0.0  1.6 136132 12684 ?        S    15:09   0:00      \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   19538  0.0  1.6 136132 12688 ?        S    15:11   0:00      \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   19651  0.0  1.6 136132 12688 ?        S    15:13   0:00      \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   19924  0.0  1.6 136132 12684 ?        S    15:17   0:00      \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   20125  0.0  1.6 136132 12688 ?        S    15:21   0:00      \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   20376  0.0  1.6 136132 12684 ?        S    15:25   0:00      \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   20437  0.0  1.6 136132 12684 ?        S    15:27   0:00      \_ /usr/bin/php /home/ab2168/public_html/generator/index.php
ab2168   21595  0.0  1.6 136132 12684 ?        S    15:29   0:00      \_ /usr/bin/php /home/ab2168/public_html/generator/index.php


--------------------------END ERROR LOGS------------------------------------------------

Help at this point will be appreciated. I cannot afford my forums going down and crashing every time i may run the generator as this makes me lose precious search engine spiders crawling my site and ranking it.
is crawled each day with xml-sitemaps.com. Thanks for helping our site reach the search engines with your amazing sitemap generator.
Re: Causing my server to crash.
« Reply #2 on: July 02, 2011, 03:28:20 PM »
Hello,

do you have a scheduled task setup to run generator?

A cron?

Yes I have a cron job set up for it to run by itself. However sometimes when I make changes to the site i run it manually.
is crawled each day with xml-sitemaps.com. Thanks for helping our site reach the search engines with your amazing sitemap generator.
Re: Causing my server to crash.
« Reply #3 on: July 03, 2011, 06:25:20 PM »
From the process list it looks like cron is being setup incorrectly and there are multiple instances of generator running at the same time. Try to remove the cron task.
Re: Causing my server to crash.
« Reply #4 on: July 04, 2011, 03:04:32 AM »
Thanks for the reply. I have removed it and do it manually now.
is crawled each day with xml-sitemaps.com. Thanks for helping our site reach the search engines with your amazing sitemap generator.