How to Limit Crawl To Specific URL String
« on: October 11, 2006, 08:32:15 PM »
How do I set the crawler to only crawl urls on my site that contain the following in the URL string: itemType=CATEGORY in the url string?

Currently the crawler is taking days to get through our site and if I can limit the sitemap to only crawl our extensive combination of categories it should bring the crawl to a more manageable crawl time.

Thanks,
Jason
Re: How to Limit Crawl To Specific URL String
« Reply #1 on: October 13, 2006, 01:29:26 AM »
Hello Jason,

currently there is no option for "Crawl only" URLs in sitemap generator, but you can use "Do not parse" option to exclude certain parts of your site.