Competitor Analysis Tool: Analyze rival websites and gain valuable SEO and PPC insights
« previous next »
Pages: 1

kstibbe

*
  • *
  • 16
Setting generator to not crawl non-existent Wiki apges
« on: June 21, 2009, 03:35:35 PM »
When the generator crawls our site it outputs a lot of non-existent links in our Wiki

For example"
Code: [Select]
wiki/index.php?title=Donna_Mia&action=edit&redlink=1

/wiki/index.php?title=Talk:Orcus

What I assume I have to do is add part of the overall link into the exclude URL

But adding =edit&redlink=1  or php?title=Talk does not seem to work.


K Stibbe
Logged

XML-Sitemaps Support

*
  • *****
  • 11783
Re: Setting generator to not crawl non-existent Wiki apges
« Reply #1 on: June 21, 2009, 04:22:45 PM »
Hello,

try to add this in "Exclude URLs" setting:
Code: [Select]
action=
title=do not forget to recreate sitemap after that.
Logged

kstibbe

*
  • *
  • 16
Re: Setting generator to not crawl non-existent Wiki apges
« Reply #2 on: June 22, 2009, 12:19:00 AM »
Right!

Trying that now!


K. Stibbe
Logged
Pages: 1
« previous next »