My first post, so please pardon my naiveté.
I'm running xml-sitemap Generator on my site and it pauses for long periods of time, wakes up and does a second or two of crawling and then pauses again. I have close to 300,000 pages.
Here's the most recent output:
Links depth: 4
Current page: BirdFinder/Month/July/AK_L1008142.pfg
Pages added to sitemap: 3619
Pages scanned: 13120 (3,859,853.2 KB)
Pages left: 273835 (+ 7 queued for the next depth level)
Time passed: 0:09:31
Time left: 3:18:46
Memory usage: 139,852.6 Kb
Auto-restart monitoring: Mon Sep 19 2011 13:21:16 GMT-0700 (PDT) (100 second(s) since last update) Resuming the last session (last updated: 2011-09-19 19:54:35)
Should I just let this run? It would go a lot faster if it didn't keep pausing. The server is my own vps running CentOS v5.5 and php v5.2.16.
Thanks for your help,
Nigel