I installed the Unlimited PHP Sitemap Generator on a large site (100K+ URL's) The first time it crawled it "looked" like it may have tried to crawl the entire site. I got errors that it could not create sitemap1.xml - sitemap5.xml. I tried creating blank files, gave them the correct permissions, but now the Generator is only crawling less than 3000 pages.
Is there a cache that I need to clear to get it to grab all the URLs? I have
Maximum pages: 0
Maximum depth level: 0
Maximum execution time, seconds: 0
Maximum memory usage, MB: 256
I also have the following:
Number of URLs per file in XML sitemap and maximum file size: 40000
Any thoughts and suggestions are welcome.
Many thanks,
Leslie
Guest