Competitor Analysis Tool: Analyze rival websites and gain valuable SEO and PPC insights
« previous next »
Pages: 1

dculp

*
  • *
  • 3
When to include image files (png, gif, jpg, etc.) in crawl?
« on: July 05, 2018, 09:20:10 AM »
In my "Configuration\Crawler rules" all image files are excluded by default. Under what circumstances should these images be included in the crawl?

Thanks,
Don C.
Logged

XML-Sitemaps Support

*
  • *****
  • 11781
Re: When to include image files (png, gif, jpg, etc.) in crawl?
« Reply #1 on: July 05, 2018, 08:03:09 PM »
Hello,

those links should be excluded from crawling (i.e. fetching from your website). They will be included in images sitemap anyway though.
Logged
Pages: 1
« previous next »