auto cron questions
« on: February 02, 2009, 04:14:16 AM »
Hi
finally, sitemap crawl finishes, takes around 5 days! we have huge site

quetion is that when we run cron to refresh sitemap files automatically, will it take 5 days EVERYTIME?

or it will skip those that have been existing and only crawl NEW ones?

we have very active forum with a lot of posts everyday
Re: auto cron questions
« Reply #1 on: February 03, 2009, 01:10:30 AM »
please?
Re: auto cron questions
« Reply #2 on: February 03, 2009, 11:25:37 PM »
Hello,

sitemap generator should start crawling your pages from the start next time, otherwise it will be unable to detect if there are any new pages on your site (i.e. it crawls your site following all links found, starting from homepage).

In case if your fresh content is limited to a specific section of your site that can be detected via URL, I'd recommend to keep existing full sitemap unchanged and configure sitemap generator to create an additional sitemap for that area *only*, using "Exclude URLs" option.
Re: auto cron questions
« Reply #3 on: February 12, 2009, 04:01:11 PM »
But you're not understanding my question. it only indexes home page. it tells me only 48 pages are indexed. Well that's pretty useless! i can do that myself!
How do I get it to index my whole site.
Re: auto cron questions
« Reply #4 on: February 12, 2009, 10:13:12 PM »
Please check your private messages inbox, I sent you 2 messages with no reply.