Competitor Analysis Tool: Analyze rival websites and gain valuable SEO and PPC insights
« previous next »
Pages: 1

spbstyle

*
  • *
  • 1
Not crawl links on pages with Meta noindex, follow
« on: May 26, 2015, 12:08:19 PM »
Hello,

The problem is in subject. This pages not crawl even if I put it into "Crawl, but do not include URLs:"

Thanx
Logged

XML-Sitemaps Support

*
  • *****
  • 11781
Re: Not crawl links on pages with Meta noindex, follow
« Reply #1 on: May 27, 2015, 06:15:49 AM »
Hello,

could you please PM me your generator URL and an example URL that is not included in sitemap and how it can be reached starting from homepage?
 
Logged
Pages: 1
« previous next »