Sitemap Generator Forum

Hello
I start the crawler in my sitemap generator and after 10 minutes i see this message

Links depth: 2
Current page: sitemap540.htm
Pages added to sitemap: 1742
Pages scanned: 2560 (63,989.9 KB)
Pages left: 321 (+ 74295 queued for the next depth level)
Time passed: 13:02
Time left: 1:38
Memory usage: 29,869.0 Kb
Resuming the last session (last updated: 2008-12-03 23:26:58)
Fatal error: Allowed memory size of 41943040 bytes exhausted (tried to allocate 35 bytes) in /var/www/html/mydomain.com/httpdocs/generator/pages/class.grab.inc.php(2) : eval()'d code on line 312

Please send me solution to resolve this problem
Tnk u

Hello,

it looks like your server configuration doesn't allow to run the script long enough to create full sitemap. Please try to increase memory_limit and max_execution_time settings in php configuration at your host (php.ini file) or contact hosting support regarding this.

I had the same problem, took your advice and had my host look into it, and they replied with this:

I increased the amount of time a script can run from 60 to 180 seconds and memory from 64MB to 256MB, then logged in and ran the script at the command line(resumed).

XML Sitemaps - Generation

Resuming the last session (last updated: 2008-12-06 22:46:59)1640 | 139 | 106,331.0 | 22:25 | 1:54 | 2 | 4,446.9 Kb | 1043 | 7362 | 4446
1660 | 119 | 107,600.7 | 22:35 | 1:37 | 2 | 4,459.0 Kb | 1055 | 7487 | 13
1680 | 99 | 108,721.2 | 22:44 | 1:20 | 2 | 4,217.1 Kb | 1066 | 7487 | -242
1700 | 79 | 110,105.5 | 22:57 | 1:04 | 2 | 4,538.8 Kb | 1079 | 7698 | 321
1720 | 59 | 110,909.2 | 23:07 | 0:47 | 2 | 4,288.3 Kb | 1087 | 7698 | -250
1740 | 39 | 112,299.3 | 23:18 | 0:31 | 2 | 4,450.1 Kb | 1100 | 7909 | 162
1760 | 19 | 113,415.6 | 23:28 | 0:15 | 2 | 4,585.4 Kb | 1111 | 7909 | 135

Fatal error: Allowed memory size of 268435456 bytes exhausted (tried to allocate 35 bytes) in /home/mysite/public_html/generator/pages/class.grab.inc.php(2) : eval()'d code on line 177

It seems to be a problem in the script. At no point did the script try to use more than about 32MB. As well, the error message is saying it tried to allocate 35 bytes which is almost nothing compared to the 268435456 bytes that were available.

Please advise as to a fix. 

Not the only one with that problem...

https://www.xml-sitemaps.com/forum/index.php/topic,2437.msg9102.html#new

Please PM me your generator URL/login.

PM'ed..... waiting....

Just pm'ed you my generator URL and login credentials.

Replied to your PM.

Thank you for the help - it works great now!

What did you guys do? I'm currently stuck by this problem as well - even with 256MB of memory.

Hello,

in most cases the issue is resolved by modifying sitemap generator configuration (Exclude/Do not parse options) to avoid crawling/indexing of noise content pages. Details are specific to a website, that's why I'm asking to provide generator URL/login details in private message to check that.