Crawling stop after few minutes
« on: January 12, 2009, 11:53:16 AM »
Hello,
on one of my site, crawling stop after few hundreds minutes:

Please wait. Sitemap generation in progress...
Links depth: 2
Current page: departement/information-dep_num-51-d-Marne.html
Pages added to sitemap: 235
Pages scanned: 240 (6,079.4 KB)
Pages left: 515 (+ 5754 queued for the next depth level)
Time passed: 3:37
Time left: 7:46
Memory usage: 2,832.3 Kb

but nothing happend.  Crawling seems stopped but  if I go to another item on the menu, then crawl again.
No sitemap are generated.

Thanks in advance

Alain
Re: Crawling stop after few minutes
« Reply #1 on: January 12, 2009, 11:41:00 PM »
Hello,

it looks like your server configuration doesn't allow to run the script long enough to create full sitemap. Please try to increase memory_limit and max_execution_time settings in php configuration at your host (php.ini file) or contact hosting support regarding this.
Re: Crawling stop after few minutes
« Reply #2 on: April 06, 2009, 05:57:51 PM »
Hello I see you mention changing the memory limit and max execution time but to how much?
Re: Crawling stop after few minutes
« Reply #4 on: April 14, 2009, 11:16:41 AM »
ive had the same problem, but being a seasoned webmaster id already dabbled with these settings, still nothing.

if i install a webserver on my pc and install this script where i have more control, can i sitemap a remote url,like on your website?
Re: Crawling stop after few minutes
« Reply #5 on: April 14, 2009, 09:42:33 PM »
Hello,

yes, you can create sitemap for your website remotely from your local PC.