Hi
I am having a problem with the sitemap generator, It seems to gradually slow down to almost a halt. To begin within the first 6 hours 100,000 pages were indexed, 24 hours later it was at 150,000 and now 24 hours after that it is at 168,000 so as you can see it has slowed down a lot. It is now running at 20 pages per every 3 mins. These pages are fetched from [ External links are visible to forum administrators only ] and I have used the do not phase urls “price-breaker-“ . It seems as if as more and more data is processed through this script it slows right down.
The computer this software is running on is a duel 3ghz p4 and serious amount of ram,
I remember reading your testimonials and one of them saying that they had captured over several million pages… not sure how this is possible with my current setup.
Any ideas why.
Guest