Problem with Sitemaps at the Webmastersprogram from Google
« on: August 02, 2009, 08:11:33 AM »
The last few days I’m getting a fault at the webmasters tools page from Google.

In my sitemap there is the normal URL and the index URL. Google says that the index URL is a copy of the normal URL and therefore it will not be indexed.
What should I do? I have removed the index URL and the status is OK, but Google isn’t indexing the URL’s.
Maybe one of you is experiencing the same problem and has a solution?

Bye,

Rene
Re: Problem with Sitemaps at the Webmastersprogram from Google
« Reply #1 on: August 02, 2009, 07:26:39 PM »
Hello,

You can exlude those pages using robots.txt file with:
Code: [Select]
User-agent: *
Disallow: /index.html