Sitemap Generator Forum

Hello,

When I saw the online demo on xml-sitemaps.com the online standalone version speed was about 1500 pages per minute, but when I am running it on my site it is about 28 pages in 3 mins? Why?

Please help.

Hello,

The crawling time itself depends on the website page generation time mainly, since it crawls the site similar to search engine bots.
For instance, if it it takes 1 second to retrieve every page, then 1000 pages will be crawled in about 16 minutes.

please let me know your generator URL/login in private message to check this.

Sent personal message.

I am getting 130000 pages in 23 minus. Used to having 130000 pages in days.
Hint was in Narrow Indexed Pages Set. Try Exclusion preset. I am now using this software without a hassle.