Subdirectory not beeing indexed
« on: November 06, 2008, 04:06:25 PM »
I have a subdirectory under mydomain.com/news which is not beeing indexed.
It is actually a wordpress installation, and for some reason the URLs are not beeing indexed by the XML generator
Any tips on what to do?
Re: Subdirectory not beeing indexed
« Reply #1 on: November 06, 2008, 07:00:27 PM »
Ok I found out the following:

In Configuration --> General Parameters --> Starting URL:
If I set it to [ External links are visible to forum administrators only ] then site is crawled but the blog is left out
 
If I set it to [ External links are visible to forum administrators only ] then blog is crawled but the rest of the site is left out!

Any ideas on how to fix it?