Competitor Analysis Tool: Analyze rival websites and gain valuable SEO and PPC insights
« previous next »
Pages: 1

mallorking

*
  • *
  • 2
Only crawls the urls from index
« on: December 05, 2008, 03:49:07 AM »
Hello, the script only crawls the urls he finds on index and not more
Logged

mallorking

*
  • *
  • 2
Re: Only crawls the urls from index
« Reply #1 on: December 05, 2008, 04:01:13 AM »
and it doesnt follow urls that are linked like "../name.php"
Logged

XML-Sitemaps Support

*
  • *****
  • 11781
Re: Only crawls the urls from index
« Reply #2 on: December 08, 2008, 07:39:10 PM »
Please PM me your generator URL/login so that I can check that.
Logged
Pages: 1
« previous next »