Sitemap Generator Forum

I've search through the forum for this error and upped the memory limit as suggested but no luck.

I keep getting this error -
Allowed memory size of 134217728 bytes exhausted (tried to allocate 9699345 bytes) in /var/www/..../pages/class.utils.inc.php(2) : eval()'d code on line 6

on the first run and then on restarting from where it stopped.

Any advice?

Thanks in advance

Chris

Hello,

how many URLs do you have indexed at that point?

I tripled the memory limit in the hope I would be able to complete one run but even that has not helped.

URLs added: 13314, estimated URLs left: 56839.

I would've expected to run into something like this if our site had hundreds of thousands of URLs but not after indexinga mere 13,314!

Chris

That definitely should not be the case, looks like the crawler find some large files (like direct video/audio links), please let me know your generator URL in private message so that I can check it.

Allowed memory size of 134217728 bytes exhausted (tried to allocate 9699345 bytes)

This is a common problem for large website with many pages.
When you view the sitemap in your browser, the site map is so large that it exceeds the 32MB limit on most shared servers. You can increase the allocated memory, but you bump into the same problem again if your website is big enough.

The solution is here: https://www.xml-sitemaps.com/forum/index.php/topic,1487.html
Break your sitemap up into multiple smaller sitemaps that use less memory.  Sitemap protocol allows you to do this, and XML-Sitemap can do it for you.

Now I recieved the "Memory Exhausted" error in the Crawling page. This is not the location I was referring to in my previous post, however, I will try the solution that I suggested and see if it works.

Nope. No solution. The Memory Exhausted error is still there at the bottom the Crawling page in the slide-window.
So the solution I proposed above does not work.

Suggestions, anyone?
Thx.

replied to your thread: https://www.xml-sitemaps.com/forum/index.php/topic,1495.html

Here is an idea, do not click on the View Sitemap tab.
Then when you run a crawl, the Crawling page will not display the sitemap in a slide window. Displaying sitemaps consumes a lot of memory. When the crawl is finished, then you can View Sitemap. 
If you get the Memory Exhausted message when you view sitemap, then refer to my earlier post on how to display the sitemap in smaller chunks.

That idea did not work. The sitemap window showed up on the Crawling page and ended with this error message:
Fatal error: Allowed memory size of 33554432 bytes exhausted (tried to allocate 8000396 bytes) in /mounted-storage/www/xmlsitemap/pages/class.utils.inc.php(2) : eval()'d code on line 8

Memory was exhausted when about 2600 pages had been added to the sitemap.

The instructions for dividing the sitemap into smaller sitemaps did not work.
 config.inc.php  contained this instruction which was supposed to keep the sitemaps down to 500 entries each.
'xs_sm_size' => '500',

well ive gone nuts and in the end i set the memory limit to -1 meaning no limit. it seems to run now. it was set to 128M before..my other sites went ok with lower figures but this particular site got stuck around 70k scanned and 45k added URLs..now it's crawling..I hope I dont crash it alltogether 

That definitely should not be the case, looks like the crawler find some large files (like direct video/audio links), please let me know your generator URL in private message so that I can check it.

I've sent you a PM with the link.

Thanks

Chris