Crawler stops working
« on: December 25, 2012, 09:41:50 AM »
Hi, my crawler stops working after sometime although I have ticked the running in the background option. Any ideas?
Re: Crawler stops working
« Reply #1 on: December 26, 2012, 02:26:15 PM »
Hello,

it looks like your server configuration doesn't allow to run the script long enough to create full sitemap. Please try to increase memory_limit and max_execution_time settings in php configuration at your host (php.ini file) or contact hosting support regarding this.
 
Crawler takes ages
« Reply #2 on: December 27, 2012, 10:32:45 AM »
Hi I started crawling a website a couple of days ago but it still keeps crawling. I have around 30k pages and wonder if usually takes that long?
« Last Edit: December 27, 2012, 11:05:39 AM by menuspring.com »
Re: Crawler stops working
« Reply #4 on: December 27, 2012, 11:04:33 PM »
It's [ External links are visible to forum administrators only ]
Re: Crawler stops working
« Reply #5 on: December 28, 2012, 05:13:20 PM »
I just tried to crawl everything again. NOw it just crawls for a second and creates a sitemap with ONE url only. HOw can I access prior versions of the sitemap?