Wordpress - Only Index is crawled
« on: May 28, 2011, 11:42:17 PM »
Hi,

I have installed the generator on a wordpress blog crawl the site, but it seems that the sitemap generator only crawls the index page?

can you please check it..
the url to the sitemap generator is:
[ External links are visible to forum administrators only ]

Thanks in advance,
Tiryaki

Re: Wordpress - Only Index is crawled
« Reply #1 on: May 29, 2011, 09:09:03 AM »
Hello,

on most of your pages you have this meta tag:
<meta name="robots" content="index, nofollow" />

you should remove it or replace "nofollow" with "follow" to get other pages indexed.
Re: Wordpress - Only Index is crawled
« Reply #2 on: May 29, 2011, 03:44:21 PM »
thanks a lot.