Sitemap Generator Forum

Hi, i am newby.
(1) You have installed 5 Sitemaps.. I have about 9.500.000 Sites with the products to crawl..is this enough?
     Are the new sitemaps build automatically or are they have to build manually?
(2) where can i see the changes? I looked at the files but the size of them are the same since yesterday.
(3) How long could the crawl take?
Thank you for infos .
and for better understanding.
Your newby..

Hello,

you  will have to create a scheduled task in your hosting control panel if you want to automatically regenerate sitemap from time to time (otherwise sitemap should be created manually).

The time depends on the page generation time mainly, since it crawls the site similar to search engine bots.
For instance, if it it takes 1 second to retrieve every page, then 1000 pages will be crawled in about 16 minutes.

Some of the real-world examples of big db-driven websites:
about 35,000 URLs indexed - 1h 40min total generation time
about 200,000 URLs indexed - 38hours total generation time

Hello Admin,
the side now was 3 times crawled always the same. and begins again in front..
I don´t want to rescan now i first want to build one Sitemap.
But it stops. and the logfile is bigger but nothing is in the sitemap till now.
Now i have 3 logfiles with the crawling results but not in the sitemap.
Perhaps could you please look at it? Perhaps i have done something wrong...
Thank you Toni

If you want to make a smaller sitemap, you should use "Maximum number of URLs" option to limit it.

i dont want to make a smaler map... 

and the big one stops cause memory...

In case if it takes too long to create a full sitemap or there is not enough memory, the recommended way is to limit "Maximum depth level" option and created limited sitemap with main URLs. That will create a "roadmap sitemap" that will greatly help search engines to crawl your site.

Hi Oleg,
i didn´t see if its crawling or not ... The date is still the 21.September...

itemap details
Request date:
21 September 2008, 15:34
Processing time:
308.85s
Pages indexed:
10388
Sitemap files:
1
Pages size:
29.36Mb
Download:
XML sitemap
In text format
In ROR format
HTML sitemap

And the button isn´t available anymore...
and the cron is run once per hour so it couldn´t be slep and always waked up again the script.
is that ok?
Thank you Toni

Yes, looks like sitemap has been created successfully.

Yes, but then i tried a little bit more links and it runs over and over.
but when i look at state there nothing happens.. Actual time is 18:56 and the side displayed is allways the same..
when i looked at this this morning at 7oclock it rans very fast there...
Thank you. Perhaps you can look? Thank you Toni

Hello,

in order to create larger sitemap PHP configuration should be updated by increasing memory_limit and max_execution_time settings.