Competitor Analysis Tool: Analyze rival websites and gain valuable SEO and PPC insights
« previous next »
Pages: 1

patchtone

*
  • *
  • 12
what parts should I exclude in my website
« on: February 14, 2010, 06:15:49 PM »
Hi.

 I am worried about security and I am a neebie to this sitemap stuff. What would be the best parts of my site to exclude. Would it be good to exclude the admin folder url, or will this effect the way the crawlers would pick up content on my site. I other do I need to exclude certain parts, or should I not be concerned.

Cheers :-\
Logged

XML-Sitemaps Support

*
  • *****
  • 11782
Re: what parts should I exclude in my website
« Reply #1 on: February 14, 2010, 07:32:13 PM »
Hello,

sitemap generator will include in sitemap only links that can be found on your pages, i.e. it cannot automatically login to admin area etc, so there is no need normally to do this type of exclusion.
Logged
Pages: 1
« previous next »