Problems getting sitemap generated
« on: February 23, 2008, 02:27:02 PM »
I having some issues getting my site map generated.

It worked in the past - but not since I changed web hosts.

The crawl gets stuck with the following message:

Links depth: 4
Current page: year7_geography/maps_atlases/imagesetc/year7_mercator_peters.doc
Pages added to sitemap: 204
Pages scanned: 220 (3,460.3 Kb)
Pages left: 423 (+ 0 queued for the next depth level)
Time passed: 0:31
Time left: 0:59
Memory usage: 736.9 Kb

Please help ...

Richard
Re: Problems getting sitemap generated
« Reply #1 on: February 24, 2008, 08:54:42 PM »
Hello,

it looks like your server configuration doesn't allow to run the script long enough to create full sitemap. Please try to increase memory_limit and max_execution_time settings in php configuration at your host (php.ini file) or contact hosting support regarding this.
Re: Problems getting sitemap generated
« Reply #2 on: February 25, 2008, 01:01:44 PM »
What limt and time would yo suggest?

Rich
Re: Problems getting sitemap generated
« Reply #3 on: February 25, 2008, 11:38:47 PM »
That depends on the total number of URLs, pages sizez and page generation time on your server. Please try increasing it step-by-step until proper values are found for your specific case.
Re: Problems getting sitemap generated
« Reply #4 on: February 26, 2008, 09:38:13 AM »
Is there an issue having the settings set far too high?

I nearly have the situation sorted - thank you for yo help so far.

Richard
Re: Problems getting sitemap generated
« Reply #5 on: February 27, 2008, 12:14:59 AM »
Not really, if you control the scripts running on your server. Still, it's recommended to keep it lower if possible.
Re: Problems getting sitemap generated
« Reply #6 on: June 25, 2008, 09:46:26 PM »
After months of working just find - it seems to have stopped working  :(

I have updated to 2.9

I have increased the values in the php.ini file to 600/600/120

But still get:

Links depth: 3
Current page: year7_geography/google_earth/imagesetc/google_earth_skills.kmz
Pages added to sitemap: 459
Pages scanned: 480 (7,361.6 KB)
Pages left: 481 (+ 16 queued for the next depth level)
Time passed: 1:06
Time left: 1:06
Memory usage: 1,096.3 Kb

My hosts have had a server upgrade and upgraded the php - could that be causing the issues?

Many thanks

Rich
Re: Problems getting sitemap generated
« Reply #7 on: June 25, 2008, 11:25:39 PM »
If you upgrade sitemap generator, make sure that you keep your old config.inc.php file to preserver configuration.
Try adding "kmz" into "exclude extensions" option.
Re: Problems getting sitemap generated
« Reply #8 on: June 26, 2008, 09:07:02 AM »
I have added kmz to the excluded extensions but not is stops here:

Links depth: 3
Current page: year8_geography/energy/wind_farm_debate_location.htm
Pages added to sitemap: 448
Pages scanned: 460 (7,264.4 KB)
Pages left: 480 (+ 14 queued for the next depth level)
Time passed: 1:10
Time left: 1:13
Memory usage: 1,160.1 Kb

Any other ideas?

Richard
Re: Problems getting sitemap generated
« Reply #9 on: June 27, 2008, 11:30:13 PM »
Hello,

did you have other customizations earlier as well (particularly in Exclude URLs/Do not parse URLs options)?
Re: Problems getting sitemap generated
« Reply #10 on: June 28, 2008, 12:59:08 PM »
No other customizations were used - other than the changes your suggested to the php.ini file - and I seem to increased those enougth?

Richard
Re: Problems getting sitemap generated
« Reply #12 on: June 28, 2008, 09:50:10 PM »
As I see, sitemap has been generated. Replied to your PM.

Sorry I don't undersatnd.

Richard