On Page SEO Checker: Get a list of improvements for your website for free in less than 5 minutes!
« previous next »
Pages: 1

john10

*
  • *
  • 1
Indexing of my site including PHPBB2 goes on indefinitely
« on: September 18, 2006, 01:46:21 PM »
Hi,

My site has a PHPBB" forum included and when using the standalone sitemap generator, it seems to keep indexing indefinitely. It went to a links depth of over 100 with about 5000pages indexed before i stopped it. the forum only has a few posts!!

I'm sure the urls were getting repeated.

Any help please??

John
Logged

XML-Sitemaps Support

*
  • *****
  • 11782
Re: Indexing of my site including PHPBB2 goes on indefinitely
« Reply #1 on: September 18, 2006, 11:35:21 PM »
Hello John,

this is how phpBB works - it produces a lot of redundant links, such as sorting links, goto post links etc. You can use "Exclude URLs" and "Do not parse URLs" option of sitemap generator to skip some of these pages.
Logged
Pages: 1
« previous next »