Big site
« on: January 04, 2019, 08:49:43 AM »
Hello guys
i have big site with bigger amounts subpages. +100 000 links. Create sitemap continues 24 hour. How speed create sitemap?

Sorry, my English is very bad.
Re: Big site
« Reply #1 on: January 04, 2019, 09:54:16 AM »
Hello,

The crawling time itself depends on the website page generation time mainly, since it crawls the site similar to search engine bots.
For instance, if it it takes 1 second to retrieve every page, then 1000 pages will be crawled in about 16 minutes.

Re: Big site
« Reply #2 on: January 04, 2019, 03:18:18 PM »
If i have 100 000 link this create sitemap for my page in 20-24 hour
Re: Big site
« Reply #3 on: January 04, 2019, 10:14:37 PM »
I change section "Maximum depth level" and create sitemap very speed :)
Re: Big site
« Reply #4 on: January 04, 2019, 10:41:04 PM »
Last question. How generate sitemap with latest added pages? When generate in file about name sitemap_news.xml this problem error in search console?
Re: Big site
« Reply #5 on: January 05, 2019, 05:33:25 AM »
Hello,
To be able to use news sitemaps for your website you must request inclusion in Google News first, otherwise news sitemap will not be processed.
[ External links are visible to logged in users only ]
Re: Big site
« Reply #6 on: January 05, 2019, 08:35:59 AM »
Ok, this is not problem.

Last problem. I can not exclude url with data string
 /c-
search/
/t-

this is not work ;/
Why i can not?
Re: Big site
« Reply #7 on: January 05, 2019, 08:45:31 AM »
Resolved problem. It works.