Sitemap only crawling Pages indexed: 527
« on: July 05, 2012, 07:05:46 PM »
Hello, my page is [ External links are visible to forum administrators only ] and the sitemap NOT crawling subcategories.

1   [ External links are visible to forum administrators only ]   2012-07-05T18:01:04+00:00   weekly   1.0000
2   [ External links are visible to forum administrators only ]   2012-07-05T18:01:04+00:00   weekly   0.8000
3   [ External links are visible to forum administrators only ]   2012-07-05T18:01:04+00:00   weekly   0.8000
4   [ External links are visible to forum administrators only ]   2012-07-05T18:01:04+00:00   weekly   0.8000
5   [ External links are visible to forum administrators only ]   2012-07-05T18:01:04+00:00   weekly   0.8000
6   [ External links are visible to forum administrators only ]   2012-07-05T18:01:04+00:00   weekly   0.8000
7   [ External links are visible to forum administrators only ]   2012-07-05T18:01:04+00:00   weekly   0.8000
8   [ External links are visible to forum administrators only ]   2012-07-05T18:01:04+00:00   weekly   0.8000
9   [ External links are visible to forum administrators only ]   2012-07-05T18:01:04+00:00   weekly   0.8000
10   [ External links are visible to forum administrators only ]   2012-07-05T18:01:04+00:00   weekly   0.8000
11   [ External links are visible to forum administrators only ]   2012-07-05T18:01:04+00:00   weekly   0.8000
12   [ External links are visible to forum administrators only ]   2012-07-05T18:01:04+00:00   weekly   0.8000
13   [ External links are visible to forum administrators only ]   2012-07-05T18:01:04+00:00   weekly   0.8000
14   [ External links are visible to forum administrators only ]   2012-07-05T18:01:04+00:00   weekly   0.8000




I need crawling follow all the links on my website, for exemple all subcategories.
Re: Sitemap only crawling Pages indexed: 527
« Reply #1 on: July 06, 2012, 06:06:40 AM »
Hello,

note that according to sitemaps protocol, sitemap cannot include URLs from different subdomains:
[ External links are visible to logged in users only ]

(from what I see, your inner links are pointing to subdomains)
Re: Sitemap only crawling Pages indexed: 527
« Reply #2 on: July 06, 2012, 08:48:36 AM »
Yes, but, for example, the second and 3 page not crawling


[ External links are visible to forum administrators only ]
[ External links are visible to forum administrators only ]
[ External links are visible to forum administrators only ]

why?
Re: Sitemap only crawling Pages indexed: 527
« Reply #3 on: July 06, 2012, 08:50:53 AM »
also not crawling:

[ External links are visible to forum administrators only ]
[ External links are visible to forum administrators only ]
[ External links are visible to forum administrators only ]
[ External links are visible to forum administrators only ]

...etc
Re: Sitemap only crawling Pages indexed: 527
« Reply #4 on: July 06, 2012, 09:10:42 AM »
Look: [ External links are visible to forum administrators only ]

only follow the firts page /p1/

lack /p2/ /p3/ /p4/ etc...

Thank you for reply, and congraturations for the script.
Re: Sitemap only crawling Pages indexed: 527
« Reply #5 on: July 06, 2012, 09:01:44 PM »
Hello,

please let me know your generator URL/login in private message to check this.
Re: Sitemap only crawling Pages indexed: 527
« Reply #6 on: July 11, 2012, 02:58:05 PM »
sent it :)