Competitor Analysis Tool: Analyze rival websites and gain valuable SEO and PPC insights
« previous next »
Pages: 1

ewise

*
  • *
  • 5
Crawling only one folder
« on: January 31, 2017, 01:56:36 PM »
Hello.

How to crawl a folder? For example: [ External links are visible to forum administrators only ]...

Thank you so much.
Logged

XML-Sitemaps Support

*
  • *****
  • 11781
Re: Crawling only one folder
« Reply #1 on: February 02, 2017, 06:26:09 AM »
Hello,

you need to specify [ External links are visible to logged in users only ] as Starting URL.
Logged

ewise

*
  • *
  • 5
Re: Crawling only one folder
« Reply #2 on: February 02, 2017, 12:10:08 PM »
Yes, I did it but crawling all site.

So I added the name of the folders I did not want in "Exclude URLs" and worked.

Thank you.
Logged
Pages: 1
« previous next »