On our phpbb forums, I have a modification installed that rewrites the urls of the topics.
Instead of the standard url ( i.e [ External links are visible to forum administrators only ] )
Our forum now rewrites urls ( i.e [ External links are visible to forum administrators only ] )
The mod can be found here: [ External links are visible to forum administrators only ]
We have the newest version of Unlimited PHP Sitemap Generator.
On the sitemap file, the generator is "printing out" the rewritten url, but it's also printing out the old version of the urls.
So for example, one topic in our forum is being printed out as [ External links are visible to forum administrators only ], but also as [ External links are visible to forum administrators only ]. So there are two entries on the site map file for every topic in our forums.
Unfortunately, some of the topics with standard urls are being indexed and showing up in search engines, which I don't want to do.
This is strange, because our Wordpress blog uses url rewriting and we don't have this "Double entry" issue with the blog.
Is there a way to these prevent standard urls from showing up in the sitemap?