Competitor Analysis Tool: Analyze rival websites and gain valuable SEO and PPC insights
« previous next »
Pages: 1

rene3

*
  • *
  • 17
robots.txt ignored by sitemap generator (v7.0)
« on: February 02, 2015, 10:19:00 AM »
Hallo

It looks like sitemap generator does ignore the robotx.txt file ?


I am prette confused..

Read...* wildcards are not allowed in the robots.txt ?

thanks
Logged

XML-Sitemaps Support

*
  • *****
  • 11782
Re: robots.txt ignored by sitemap generator (v7.0)
« Reply #1 on: February 03, 2015, 05:41:19 AM »
Hello,

robots.txt is supported.

What is your robots.txt URL, an example of directive and URL that is added in sitemap?
Logged

rene3

*
  • *
  • 17
Re: robots.txt ignored by sitemap generator (v7.0)
« Reply #2 on: February 03, 2015, 08:11:38 AM »
I did had som * (wildcards) ...could this be the reason ?

that everthing down from the wildcard got ignored ?

cheers
Logged

XML-Sitemaps Support

*
  • *****
  • 11782
Re: robots.txt ignored by sitemap generator (v7.0)
« Reply #3 on: February 03, 2015, 08:34:10 AM »
Wildcards are supported.
Logged
Pages: 1
« previous next »