csd

*
  • *
  • 2
Stops crawling and doesnt create sitemap
« on: May 11, 2013, 04:00:00 PM »
hi
Installed the software on a windows server, starts to crawl bt stops and doesnt create sitemap, tried resuming the crawl but nothing happens.

Any ideas?
Chris
Re: Stops crawling and doesnt create sitemap
« Reply #1 on: May 13, 2013, 01:31:11 PM »
Hello,

it looks like your server configuration doesn't allow to run the script long enough to create full sitemap. Please try to increase memory_limit and max_execution_time settings in php configuration at your host (php.ini file) or contact hosting support regarding this.
 
Re: Stops crawling and doesnt create sitemap
« Reply #2 on: January 07, 2014, 09:04:34 AM »
Hi

I have the same problem. I run a price comparison system [ External links are visible to forum administrators only ], so I have several hundert thousand products/links in my website. The crawler always stops after one thousand links.

I already tried to adjust the server-settings. But Its not my server (just a webspace), so I am not fully free with the adjustments.

Is there another solution? What about a cronjob?

Thaks for you help
Re: Stops crawling and doesnt create sitemap
« Reply #3 on: January 10, 2014, 06:49:17 AM »
Hello,

in this case I would recommend to try running generator in command line if you have ssh access to your server.