Sitemap Generator Forum

I have installed the sitemap generator and it crawls all the pages on my site except the ones in a specific directory.

I have looked to see if there is any no follows and robot.txt but everything seems to be in order.

This is the most important directory on my site as it contains 20,000+ of my products.

[ External links are visible to forum administrators only ]
WON@T CRAWL - [ External links are visible to forum administrators only ]


do you have an suggestions of why this would happen?

thanks

problem solved. don't know how but its now working.

next problem.....

crawling stops at 1804 pages and won't go no further. all very frustrating!!!!!!!!!!!!

Hello,

please PM me your generator URL/login.