Competitor Analysis Tool: Analyze rival websites and gain valuable SEO and PPC insights
« previous next »
Pages: 1

webmaster22

*
  • *
  • 4
I cannot get the new version to complete a crawl of my website
« on: September 27, 2006, 09:19:09 PM »
I have installed the new version of the Site Map Generator and cannot get it to crawl my website. I have increased the PHP memory to 32 MB then 64 MB with no luck.  Why won't this crawl my website? carefreetrip.com  :(

[ External links are visible to forum administrators only ]

I also set the Save the script state, every X seconds to every 30 seconds and have tried to continue the interrupted session (2006-09-27 16:33:58, URLs added: 410, estimated URLs left: 2280) 16 times and it still won't finish.  What else is there to do???
« Last Edit: September 27, 2006, 10:34:32 PM by webmaster22 »
Logged

XML-Sitemaps Support

*
  • *****
  • 11781
Re: I cannot get the new version to complete a crawl of my website
« Reply #1 on: September 28, 2006, 01:12:27 AM »
Hello,

you have max_execution_time setting defined to 30 in php.ini. It means that script is interrupted by server after about 30 seconds.
Please increase it to, say 3000 (depending on the size of your site) and restart the crawler.
Logged
Pages: 1
« previous next »