Particular URL Sitemap
« on: January 04, 2016, 09:12:57 AM »
We want control the sitemap generation process to create separate files based on type of url of website because of the total number of URL are in excess of 1Mill.
How can we do this?
Thanks
Re: Particular URL Sitemap
« Reply #1 on: January 04, 2016, 10:40:38 AM »
Hello,

you can use "Exclude URLs" setting to block some URLs from indexing.
Also, if the starting URL is domain.com/folder/ then only URLs from folder/ will be indexed.
Re: Particular URL Sitemap
« Reply #2 on: January 04, 2016, 10:53:01 AM »
Our website is using dynamic url's which are mysql database based and not folder based. All urls have a particular starting to easy identification. How can we achieve selective Sitemap creation in this situation.

Thanks
Re: Particular URL Sitemap
« Reply #3 on: January 04, 2016, 09:29:48 PM »
You can specify a substring of URL in Exclude URLs setting to block all links with that substring.
Also, you can use "Parse ONLY" setting to specify which links should be crawled on website (opposite to "Exclude URLs" setting).