Not indexing all URLS
« on: November 01, 2013, 11:57:19 PM »
My site is using asp.net. I use the following rewrite/redirect tool to force urls to lowercase, but it prevents some urls from being added to my site map. (If i remove this rule, the sitemap generator works fine-except for the fact that it adds uppercase and lowercase versions of some pages. I need this rule as I just recently standardized my urls to lowercase for SEO)

<rule name="Convert to lowercase"  stopProcessing="true">
           <match url="[A-Z]" ignoreCase="false" />
           <action type="Redirect" url="{ToLower:{URL}}" />
        </rule>

The rewrite works fine. It shows as a 301 and all of my urls are always lowercase. Why is it breaking this sitemap generator and how do I fix it?
Re: Not indexing all URLS
« Reply #1 on: November 02, 2013, 12:37:58 AM »
nevermind. I spent hours on this and it ended up being a line in my robot.txt file  :-\