Sitemap Generator Forum

We're having a problem running site maps greater than 4 levels deep.  The generator consistently hangs with no error message.  I've checked php.ini and upped timeouts and memory allocation.  Currently, we're at 600 seconds for script timeout and parsing timeout, and 64mb memory allocation.

When I run level 4, it completes in less than 2 minutes with no errors.  When i kick off a level 5 crawl, it won't even complete level 4 - stops about halfway through level 4.

Level 4 sitemap has a little over 6100 pages.

We're getting kinda desperate to run a more complete map because we do have some things not indexing properly on Google and we also need to check links at the next levels down.  All help will be gratefully accepted!

Thanks, Karen

Hello,

in most cases it's possible to improve site crawling performance by modifying "Do not parse"/"Exclude" settings. Please PM me your generator link so that I can check it.

Well, i successfully got a 5-level report run this morning (finally!) and am now trying for level 6.  The ONLY change I made to it was to specify 64MB explicitly in the server memory usage max field on Generator's config tab. That field was previously blank, and it didn't seem to be reading it correctly from the server.

The "do not parse" and "exclude" settings were already fairly well populated, so i left them alone. 

Thanks!
Karen

Replied to your PM.