Competitor Analysis Tool: Analyze rival websites and gain valuable SEO and PPC insights
« previous next »
Pages: 1

updates1122

*
  • *
  • 2
24 Hours passed, and Crawling Continue
« on: May 24, 2017, 10:10:55 AM »
Is there any problem with your software? How much time it will take to generate sitemap of a  website of 20,000 pages..????
Logged

XML-Sitemaps Support

*
  • *****
  • 11780
Re: 24 Hours passed, and Crawling Continue
« Reply #1 on: May 24, 2017, 01:14:32 PM »
Hello,

The crawling time itself depends on the website page generation time mainly, since it crawls the site similar to search engine bots.
For instance, if it it takes 1 second to retrieve every page, then 1000 pages will be crawled in about 16 minutes.
Logged

updates1122

*
  • *
  • 2
Re: 24 Hours passed, and Crawling Continue
« Reply #2 on: May 24, 2017, 03:40:12 PM »
No way, Its not working likethis.. My website only have 20,000 pages, and your software is working from 15 hours or more... Can You check my statistics, Its too slow
Logged

XML-Sitemaps Support

*
  • *****
  • 11780
Re: 24 Hours passed, and Crawling Continue
« Reply #3 on: May 24, 2017, 04:44:20 PM »
Hello,

please let me know your generator URL/login in private message to check this.
Logged
Pages: 1
« previous next »