Sitemap Generator Forum

i'm trying to get the sitemap generator to log all links for my osCommerce website. by "all links" i mean all the categorical links, as well as all the product links and nothing more. right now what the generator is doing is going through everything, including all the buy it now links, review links, etc. How do I exclude those? What depth link am i looking at?

URL: [ External links are visible to forum administrators only ]

Hello,

you should use "Exclude URLs" option to avoid crawling of those pages, here is a good list for osCommerce: https://www.xml-sitemaps.com/forum/index.php/topic,1241.html

Hello,

you should use "Exclude URLs" option to avoid crawling of those pages, here is a good list for osCommerce: https://www.xml-sitemaps.com/forum/index.php/topic,1241.html

awesome thanks. i'll give it a shot and let u know

well it was working but now it seems to be getting timed out again. it stopped at 7000 pages scanned with 15k more left to go.

Please PM me your generator URL.