Sitemap Generator Forum

HI,

I'm sure this is an easy question to answer, but should the sitemap generator exclude files disallowed in the robots.txt file? Files disallowed in my robots.txt file still seem to be generated in the sitemap. Maybe I have missed something in the settings? Or maybe there is something wrong with my robots file.

I'm trying to not include files with the text "view_map" in the URL. Here is an extract from the robots.txt file:

User-Agent: *
Disallow: /*view_map
Allow: /

Cheers,

Andy

Hello,

yes, robots.txt is supported. What is an example URL that is still included in sitemap?

Hello,

yes, robots.txt is supported. What is an example URL that is still included in sitemap?

[ External links are visible to forum administrators only ] for example.

I see that you are running sitemap generator v2.8, please try installing the latest version (3.0)

Updated to v3.0 and it worked perfectly with the robots.txt file.

Thanks!

Great!