Sitemap Generator Forum

Hello,

When I try the demo on two of my sites, only parts of the site are indexed (a very small part).

The sites are:
[ External links are visible to forum administrators only ]
[ External links are visible to forum administrators only ]

both sites start out with two pages. One links to subdomains and the other subfolders.  Each subfolder has many pages.

Will I have the same problem with the script?

Hello,

according to the xml sitemap protocol, it's not allowed to include URLs from other (sub)domains in sitemap, so the crawler skips them.

ok, so if it won't index, say [ External links are visible to forum administrators only ], why won't it index [ External links are visible to forum administrators only ] which is under [ External links are visible to forum administrators only ]  Is it because the www is missing?

Yes, that's right - "www" prefix means another domain name in this case.

I still don't understand why the folders at [ External links are visible to forum administrators only ] are not being indexed - only 17 pages are indexed but each folder has many articles.  Here are the links:

            <table width="100%"  border="0" align="center" cellpadding="2" cellspacing="0">
              <tr valign="top" class="style2">
                <td class="style3"><a href="[ External links are visible to forum administrators only ]">Anxiety</a></td>
                <td class="style3"><a href="[ External links are visible to forum administrators only ]">Stress</a></td>
                <td class="style3"><a href="[ External links are visible to forum administrators only ]">Stress and Anxiety Medications </a></td>
                <td class="style3"><a href="[ External links are visible to forum administrators only ]">Herbal Medications</a></td>
                <td class="style3"><a href="[ External links are visible to forum administrators only ]">Alternative Medicines and Therapies</a></td>
              </tr>
              <tr valign="top" class="style2">
                <td class="style3"><a href="[ External links are visible to forum administrators only ]">Social Anxiety </a></td>
                <td class="style3"><a href="[ External links are visible to forum administrators only ]">Panic Disorders</a></td>
                <td class="style3"><a href="[ External links are visible to forum administrators only ]">Depression</a></td>
                <td class="style3"><a href="[ External links are visible to forum administrators only ]">Panic Attacks </a></td>
                <td class="style3"><a href="[ External links are visible to forum administrators only ]">Psychologist</a></td>
              </tr>
              <tr valign="top" class="style2">
                <td class="style3"><a href="[ External links are visible to forum administrators only ]">Stress Management</a></td>
                <td class="style3"><a href="[ External links are visible to forum administrators only ]">Behavior Modifications </a></td>
                <td class="style3"><a href="[ External links are visible to forum administrators only ]">Anxiety Symptoms and Stress Signs</a></td>
                <td class="style3"><a href="[ External links are visible to forum administrators only ]">Mental Health</a></td>
                <td class="style3"><a href="[ External links are visible to forum administrators only ]">Stress and Anxiety Relief</a></td>
              </tr>
              <tr valign="top" class="style2">
                <td colspan="5" class="style3"><a href="[ External links are visible to forum administrators only ]">Stress & Anxiety Blog</a></td>
            </tr>
            </table>

Am I missing something in the way the links are set up?

Hello,

the "www. yourdomain .com/anxiety" link is redirected to "yourdomain .com/anxiety" for me.

I still have the same result if I start spidering at [ External links are visible to forum administrators only ] instead of [ External links are visible to forum administrators only ].

The links are pointing to www domain on your pages (although they are redirected to non-www then). Make sure that ALL links (both on-page and landing URLs after redirect) reside  on exactly the same domain (non-www or www domain).

Thank you!

Posted by: AndrewTraub
I still have the same result if I start spidering at [ External links are visible to forum administrators only ] instead of [ External links are visible to forum administrators only ].

Thank you

You *should* use www domain as Starting URL since your links are pointing to it.