How to Exclude Wordpress when crawling subdirectory?
« on: February 01, 2010, 07:36:19 PM »
Hey there,

I am trying to figure how to exclude wordpress from the crawling process.  I am installing a Scuttle Bookmarking site in a subdirectory and I want to use the sitemap generator only for it.

My domain looks like this:

[ External links are visible to forum administrators only ]

I use a wordpress plugin for its sitemaps, so I only want my Scuttle Bookmarks site to be crawled by the Sitemap Generator.

How can I exclude all the stuff in the root of the domain from crawled and only crawl that subdomain?

Thank you in advance.
Re: How to Exclude Wordpress when crawling subdirectory?
« Reply #1 on: February 02, 2010, 03:01:24 AM »
Hello,

you can simply define Starting URL as:
[ External links are visible to logged in users only ]

and URLs formdomain root will not be included in sitemap.