rene3

*
  • *
  • 17
looks like robots.txt does not get counted
« on: April 03, 2015, 02:45:23 PM »
I have this in robots.txt

Disallow: /Impressum/
Disallow: /agb/
Disallow: /Nach-Hersteller/
Disallow: /nach-Kategorie/

Ultimate Generator does ignore them...

what could be wrong



rene3

*
  • *
  • 17
Re: looks like robots.txt does not get counted
« Reply #1 on: April 03, 2015, 05:05:52 PM »
robots.txt

is case sensitiv...

oxid produces upper and lowercase...

this helped