How to exclude certain URL's
« on: October 06, 2014, 05:10:16 PM »
Hello,

I'm having trouble excluding certain URL strings. I tried doing this on the configuration page, but the URL's are still being included in the sitemaps. Any advice?

Thanks!
Re: How to exclude certain URL's
« Reply #1 on: October 06, 2014, 08:46:49 PM »
Hello,

what is an example  URL you are trying to exclude and the setting you have defined?
Re: How to exclude certain URL's
« Reply #2 on: October 06, 2014, 08:56:57 PM »
I was trying to exclude all the URL's below within the "Exclude URLs" box in the configuration page:

[ External links are visible to forum administrators only ]
[ External links are visible to forum administrators only ]
[ External links are visible to forum administrators only ]

Re: How to exclude certain URL's
« Reply #3 on: October 07, 2014, 12:06:39 PM »
You should specify them without domain name in Exclude URLs:
blog/page/
blog/author/
Re: How to exclude certain URL's
« Reply #4 on: October 07, 2014, 02:23:05 PM »
I tried that and re-crawled manually, but the links I requested to exclude were still included in sitemap.xml.
Re: How to exclude certain URL's
« Reply #5 on: October 07, 2014, 07:06:49 PM »
I also tried with sitemap-blog.xml, and that didn't work either.
Re: How to exclude certain URL's
« Reply #6 on: October 08, 2014, 06:04:06 AM »
Hello,

please let me know your generator URL/login in private message to check this.