Sitemap Generator Forum

I understand this is unlimited and thats great. Its been running sound for 3 days straight. my link depth is at 16 and links added are at 300,000, at half a meg. is there a command to stop and have it build the site maps for what its already got? Im good with 300k links. Thanks

Hello,

you can set "Maximum URLs" setting to 300000 to avoid crawling your site further.

Thanks I guess I should have thought of that. I was mostly worried about interrupting. Is half a million links too many to submit?

I interrupted and now my crawling page doesnt seem to give me the option to start the scrip again. Just the option to run in the background.

Hello,


looks like memory limit is exceeded when generator tries to read the crawling session file, you need to increase memory_limit in PHP configuration to resolve that.

Sorry that didn't work I set it to 50,000. All I'm getting on the crawling page is:

No sitemaps found
Sitemap was not generated yet, please go to Crawling page to start crawler manually or to setup a cron job.
Crawling
Run in background
Do not interrupt the script even after closing the browser window until the crawling is complete


No start button. Seems as if, when i interrupted it, its gone now?

Hello,

try to run in from scratch with this URL: domain.com/generator/index.php?op=crawlproc

WHat happened that saved a site map of 600 links? I had it up to 400,000. Am i just gonna have to run it again because of my poor configuration? Its not giving me the option to continue my crawl:(?

Hello,

didn't you set "Maximum URLs" to "600" accidentally? Make sure that it's set to "300000" and run generator again.

no but I used a comma and I suppose that is what did it 600,000. I have to just run it for another 3 days to get it back up. I can't seem to set the links to anything but 0 or it will not work. So I just set the link depth to 10 that will work for now. I'm sick of waiting on this hahaha.

Yes, limiting the depth level should work too.