Sitemap Generator Forum

Hello

Nice software and easy to install, i have 5 web sites hosted on the godaddy server and the web sites are large in urls.I tested the free trial and install was fine, but i have tried to config this for large web sites and find the sotware just stops working.

Question 1 What's the time frame for large web sites ie - over 40,000 urls

Question 2 What the config setting i should change to.

Thanks for any help

michael

edit

i have re-installed on the server and in testing now

Already in progress. Current process state is displayed:
Links depth: 1
Current page: 0/posts/29-Home-Garden/212-Clothing/
Pages added to sitemap: 636
Pages scanned: 640 (38,312.1 KB)
Pages left: 703 (+ 5858 queued for the next depth level)
Time passed: 0:02:15
Time left: 0:02:29
Memory usage: 4,558.2 Kb

thats what is up at the moment and is not moving

thanks

michael

Hello

Nice software and easy to install, i have 5 web sites hosted on the godaddy server and the web sites are large in urls.I tested the free trial and install was fine, but i have tried to config this for large web sites and find the sotware just stops working.

Question 1 What's the time frame for large web sites ie - over 40,000 urls

Question 2 What the config setting i should change to.

Thanks for any help

michael

edit

i have re-installed on the server and in testing now

Already in progress. Current process state is displayed:
Links depth: 1
Current page: 0/posts/29-Home-Garden/212-Clothing/
Pages added to sitemap: 636
Pages scanned: 640 (38,312.1 KB)
Pages left: 703 (+ 5858 queued for the next depth level)
Time passed: 0:02:15
Time left: 0:02:29
Memory usage: 4,558.2 Kb

thats what is up at the moment and is not moving

thanks

michael

ok

this is what i get in the report

Links depth: 1
Current page: -258-Western-Sahara/
Pages added to sitemap: 1336
Pages scanned: 1340 (119,766.5 KB)
Pages left: 7 (+ 277601 queued for the next depth level)
Time passed: 0:05:11
Time left: 0:00:01
Memory usage: 81,234.8 Kb
Resuming the last session (last updated: 2010-02-15 14:13:26)
Fatal error: Out of memory (allocated 178782208) (tried to allocate 27263100 bytes) in /home/content/q/t/e/qtellwholesale/html/qtellclassifiedads.com/generator/pages/class.utils.inc.php(2) : eval()'d code on line 27

So what do i need to set the config to

thanks

michael

Hello,

it looks like your server configuration doesn't allow to run the script long enough to create full sitemap. Please try to increase memory_limit and max_execution_time settings in php configuration at your host (php.ini file) or contact hosting support regarding this.

Hello thanks for the quick reply

I spoke with the hosting company at godaddy

Now im just unsure of the coding which i need to write for this to increase the memory.

I have done tests and works for 1450 url's then fail

If you have had the issue before could you please supply the coding required or any web site that would supply a type of coding required for the php.ini file

Thanks

Michael

Hello,

try to set memory_limit to 256M.

Hello

Thanks for the quick reply again and support.

Im on shared hosting at godaddy unlimited package, and I have five classifiedads web sites that need deep site maps, now when you upload the script the linit is set at 256m so i have changed to "0" just to try and the same results, no matter which way this is set the result is the same.

Its a hardware issue not software issue software is fine and works well.

Now i just did a test again at the 256 settings and just to give you a idea of whats coming this is the test results

Links depth: 1
Current page: -239-Togo/
Pages added to sitemap: 1516
Pages scanned: 1520 (138,036.2 KB)
Pages left: 30 (+ 300778 queued for the next depth level)
Time passed: 0:08:19
Time left: 0:00:09
Memory usage: 87,666.6 Kb
Resuming the last session (last updated: 2010-02-17 16:39:48)
Fatal error: Out of memory (allocated 179044352) (tried to allocate 44 bytes) in /home/content/q/t/e/qtellwholesale/html/qtellb2btrade.com/generator/pages/class.utils.inc.php(2) : eval()'d code on line 27

so you will see that site map is up at 300000 plus for next level

So server is not up to the scope of works required for complete site map

thanks for the help

If you require i can provide ftp login plus passwods used in the account if you need to test the script yourself.

The big issue now is "have a made a monster in site map" 

Michael

Hello,

with website of this size the best option is to create a limited sitemap - with "Maximum depth" or "Maximume URLs" option limited so that it would gather about 40-50,000 URLs, which would be main pages representing "roadmap" sitemap for search engines.