Sitemap Generator Forum

Hi There,

I have my sitemap generator running on [ External links are visible to forum administrators only ]

I include links to the sitemaps in my footer.

My site is dynamic and pages are added and removed every night around 00:00 - 01:00.

Cron is set to run at 02:00

The generator is crawling the sitemap links and adding pages to the sitemap that have been removed that day. So my sitemap is growing constantly and includes pages that have been deleted.

Is there a fix for this? Can I exclude it crawling the current sitemap files/links?

Cheers,
Adam

Helloi,

you should put "sitemap_build/" in "Do not parse" setting so that generator doesn't crawl old sitemap (that contains links to old pages)