Sitemap Generator Forum

Using a vbulletin forum and used the settings to not crawl specific pages, e.g. profiles. But only a fraction of the actual forum pages are crawled. Here is the sitemap: [ External links are visible to forum administrators only ]  There should be far more threads indexed.

It's also not crawling wordpress blogs properly. If you look at the end of the sitemap, there are a whole bunch of links that are individual links but are actually part of one blog. it isn't recognizing them properly even if they are in their own directory (I used sort by directory.)

Hello,

could you please PM me your generator URL and an example URL that is not included in sitemap and how it can be reached starting from homepage?