Sitemap Generator Forum

Hello Members,

I have a query regarding the "Unlimited Sitemap Generator" script. I recently purchased this script and started running it on a website containing approximately half a million to a million links. The script has been running in the background for the past two days and has yet to complete.

Does anyone have experience with this script and can provide insights on how long it typically takes to process a website of this size?

Thank you in advance for your guidance!

Hello,


The crawling time itself depends on the website page generation time mainly, since it crawls the site similar to search engine bots.
For instance, if it it takes 1 second to retrieve every page, then 1000 pages will be crawled in about 16 minutes.

Some of the real-world examples of big db-driven websites:
about 35,000 URLs indexed - 1h 40min total generation time
about 200,000 URLs indexed - 38hours total generation time