Generator Not Adding All Pages To Sitemap
« on: June 18, 2014, 03:41:00 PM »
First time creating sitemap worked without problems.  Submitted over 7000 pages to sitemap.  Second time I ran it, a couple of week later, generator only submitted 2400.  It scanned over 10,000 pages, but over looked many like this....

[ External links are visible to forum administrators only ]

I've restored the old sitemap here...[ External links are visible to forum administrators only ]

The new one is here...[ External links are visible to forum administrators only ].

As you can see it's quite smaller.

Why didn't the new scan reveal all the pages on the site, plus all the new pages I added since the first crawl?  The new site map should have been bigger.

Please advise.
Re: Generator Not Adding All Pages To Sitemap
« Reply #1 on: June 18, 2014, 11:20:38 PM »
Below are a couple more samples of URLS that were submitted in the first sitemap that I created, but are excluded from the new sitemap.  I double checked robots.txt as well as noindex tags, and there's nothing that I can see that would prevent these from being indexed...

[ External links are visible to forum administrators only ]
[ External links are visible to forum administrators only ]
[ External links are visible to forum administrators only ]

Please help.
Re: Generator Not Adding All Pages To Sitemap
« Reply #2 on: June 19, 2014, 11:19:29 AM »
Hello,

could you please PM me your generator URL and describe how those missing pages can be reached starting from homepage?
 
Re: Generator Not Adding All Pages To Sitemap
« Reply #3 on: June 20, 2014, 01:16:31 AM »
Ok..Let me know if you require anything else?
Re: Generator Not Adding All Pages To Sitemap
« Reply #4 on: June 21, 2014, 12:00:45 AM »
Support, Can you please give me an update?