out of memory issues
« on: April 18, 2008, 12:33:15 AM »
Hi everybody and the admin. I love the product. But my site has grown. I am facing out of memory issues. I have tried juggling the var_export and other option, I have set the memory in php.ini to 128M. I have filters in the crawl config, so that the total # of urls is something like 25000.
I have read a few posts about this same issue, apparently without any resolution.
And i have tried using command line to
php runcrawl.php

This is the way i am working around it. I have made copies, and feed suburls to the sitemap gen. So each copy has less to crawl. But i have multiple sitemaps now. This is too much of a compromise.


I need HELP !.



Sam

please excuse my login id. I am not admin in anyway.
« Last Edit: April 18, 2008, 12:39:24 AM by admin115 »
Re: out of memory issues
« Reply #1 on: April 18, 2008, 12:44:44 AM »
Hello,

please try to disable ROR/HTML sitemaps options and changelog calculation.
Re: out of memory issues
« Reply #2 on: April 18, 2008, 05:40:09 PM »
ok tried this too , but still remains unresolved.
Re: out of memory issues
« Reply #3 on: April 18, 2008, 10:06:30 PM »
Please PM me your generator URL and I will see if crawling settings can be further optimized.
Re: out of memory issues
« Reply #4 on: April 19, 2008, 01:50:33 AM »
Please check your PM.  I would love to see this resolved !
« Last Edit: April 19, 2008, 02:05:32 AM by admin115 »