me3

*
  • *
  • 3
one more fatal error, memory limit post
« on: March 17, 2007, 02:17:50 PM »
I just installed this sitemap generator, and am having major problems with it.  I am getting the same memory limit error as a lot of other people, and tried all of the posted fixes.  As this is on a dedicated box I was able to set the memory limit up to 500 megs.  It still failed.  I am very concerned about running any program that requires that much memory on my box.  Why doesn't it periodically write the memory to cache files before it fails?
Re: one more fatal error, memory limit post
« Reply #1 on: March 17, 2007, 10:37:25 PM »
Quote
Why doesn't it periodically write the memory to cache files before it fails?
Hello,

you can use "Save state" option for that.

me3

*
  • *
  • 3
Re: one more fatal error, memory limit post
« Reply #2 on: March 19, 2007, 12:34:59 PM »
this is for a realty site where we want to index all of the properties, so there are a lot of pages.

Links depth: 1
Current page: useful_stuff/resource/Massachusetts_North_Shore_Real_Estate.html
Pages added to sitemap: 40
Pages scanned: 40 (12,752.1 Kb)
Pages left: 253 (+ 107302 queued for the next depth level)
Time passed: 0:15
Time left: 1:36
Memory usage: 31,787.3 Kb

Fatal error: Allowed memory size of 524288000 bytes exhausted (tried to allocate 2358141 bytes) in /home/windhill/public_html/sitemap/pages/class.grab.inc.php(2) : eval()'d code on line 298

are the details.  I set the save state to 5 seconds, and it is still crashing.
Re: one more fatal error, memory limit post
« Reply #3 on: March 19, 2007, 09:02:59 PM »
Saving the state every 5 seconds is way too often. You should set it to a few minutes (90-300 seconds).
Also, for larger sites it is recommended to execute it from the command line (via SSH access).

me3

*
  • *
  • 3
Re: one more fatal error, memory limit post
« Reply #4 on: March 19, 2007, 10:27:58 PM »
if i do run it from the command line will i still have the memory errors?
Re: one more fatal error, memory limit post
« Reply #5 on: March 20, 2007, 08:14:29 PM »
Usually the scripts executed from command line use different php configuration comparing to web scripts, so your memory limit may be higher (or no limit at all).