Sitemap Generator Forum

Hello Members,

I have a query regarding the "Unlimited Sitemap Generator" script. I recently purchased this script and started running it on a website containing approximately half a million to a million links. The script has been running in the background for the past two days and has yet to complete.

Does anyone have experience with this script and can provide insights on how long it typically takes to process a website of this size?

Thank you in advance for your guidance!

Hello,


The crawling time itself depends on the website page generation time mainly, since it crawls the site similar to search engine bots.
For instance, if it it takes 1 second to retrieve every page, then 1000 pages will be crawled in about 16 minutes.

Some of the real-world examples of big db-driven websites:
about 35,000 URLs indexed - 1h 40min total generation time
about 200,000 URLs indexed - 38hours total generation time

It has been six days since the process started, but it remains stuck or running with no visible status updates.

Should I consider terminating the process, or is it advisable to let it continue running? Additionally, is there a way to monitor the current status of the script to determine if it is still progressing?

I have also attached a screenshot for your reference, where you can see that the statuses are not being displayed.

Any Suggestion on this ?

You can open generator page in another browser to see the current progress. Also, in default configuration generator saves the crawling progress at specified intervals so you can stop it and resume later.