Sitemap Generator Issue - not following links ?
« on: November 25, 2008, 02:40:41 PM »
Hi,

I have successfully installed this software and it works very well however, I am very please with it - one problem is that it does not follow all the links on a  page.

Eg.

I have a link like this on the Homepage - (and on other pages too):-

[ External links are visible to forum administrators only ]

- and it is NOT in the sitemap - and it doesn't follow the links on that page either!

btw: real site is [ External links are visible to forum administrators only ]

any ideas why links like this are not being indexed / crawled / followed ?

(this is not a rel=nofollow issue)
« Last Edit: November 25, 2008, 07:59:17 PM by admin »
Re: Sitemap Generator Issue - not following links ?
« Reply #1 on: November 25, 2008, 08:01:52 PM »
Hello,

I cannot find that link on your homepage:
https://www.xml-sitemaps.com/se-bot-simulator.html?op=se-bot-simulator&go=1&pageurl=http%3A%2F%2Fwww.simply-yoga.co.uk%2F&se=googlebot&submit=Start

Also, make sure that all your inner links are pointing to the same domain (with www.), otherwise they cannot be included in sitemap.
Re: Sitemap Generator Issue - not following links ?
« Reply #2 on: November 25, 2008, 09:52:23 PM »
::) ok - is a  dynamic link that pops up at certain time of day - so i have put #test link# on the homepage and it is not picking it up even though it is  a static active link -  it DOES show up on the robot simulator though - weird huh ?
Re: Sitemap Generator Issue - not following links ?
« Reply #3 on: November 26, 2008, 02:34:36 AM »
::) ok - is a  dynamic link that pops up at certain time of day - so i have put #test link# on the homepage and it is not picking it up even though it is  a static active link -  it DOES show up on the robot simulator though - weird huh ?


:o

markup error on page - whoops - all is well
Re: Sitemap Generator Issue - not following links ?
« Reply #4 on: November 26, 2008, 08:42:55 AM »
even though  markup error on page has been fixed - generator still does not pick up support article link on homepage - why is this ?
Re: Sitemap Generator Issue - not following links ?
« Reply #5 on: November 26, 2008, 02:27:18 PM »
even though  markup error on page has been fixed - generator still does not pick up support article link on homepage - why is this ?

because am using dynamic meta robots header !  ;D

- all working now