only crawling a few links
« on: August 02, 2006, 09:29:07 PM »
i have the sitemap generator set up to work on a mediawiki installation, but it is only getting 14 links. it appears that it isn't going past the first level. i have no settings limiting what the generator can crawl, and the start URL is the base domain of the site (ie. domain.com, not domain.com/wiki/). the online version saw several hundred links. any ideas?

thanks in advance.
Re: only crawling a few links
« Reply #1 on: August 02, 2006, 10:47:00 PM »
Hello,

please make sure that "Starting URL" you specify for sitemap generator has exactly the same domain as links at your site.
For instance, domain.com and [ External links are visible to logged in users only ] are different domains.
Re: only crawling a few links
« Reply #2 on: August 02, 2006, 10:54:28 PM »
the starting URL is correct. I tried a few different things, and all worked as expected, but it never goes past the first depth level.