Competitor Analysis Tool: Analyze rival websites and gain valuable SEO and PPC insights
« previous next »
Pages: 1

william1

*
  • *
  • 3
not the whole site is being spidered
« on: April 13, 2010, 08:43:13 PM »
Hi All

I have noticed that not all the pages on my site are being spidered by XML-sitemaps.

Any ideas?

Ww
« Last Edit: April 13, 2010, 08:45:06 PM by william1 »
Logged

xml-sitemaps

*
  • *****
  • 146
Re: not the whole site is being spidered
« Reply #1 on: April 14, 2010, 05:37:36 PM »
Hi, make sure you have links to these pages otherwise they won't be found.

You can also try our search engine robot simulator to see how robots view your site.

https://www.xml-sitemaps.com/se-bot-simulator.html
Logged
Philip Nicosia
Pages: 1
« previous next »