Indexing of my site including PHPBB2 goes on indefinitely
« on: September 18, 2006, 01:46:21 PM »
Hi,

My site has a PHPBB" forum included and when using the standalone sitemap generator, it seems to keep indexing indefinitely. It went to a links depth of over 100 with about 5000pages indexed before i stopped it. the forum only has a few posts!!

I'm sure the urls were getting repeated.

Any help please??

John
Re: Indexing of my site including PHPBB2 goes on indefinitely
« Reply #1 on: September 18, 2006, 11:35:21 PM »
Hello John,

this is how phpBB works - it produces a lot of redundant links, such as sorting links, goto post links etc. You can use "Exclude URLs" and "Do not parse URLs" option of sitemap generator to skip some of these pages.