Keyword suggestion tool: Pick the right keywords to target in your SEO and PPC campaigns
« previous next »
Pages: 1

ohadziv

*
  • *
  • 1
how to scan password protected sites
« on: May 25, 2009, 02:14:32 PM »
Hi
I have a site for members only.
after you type the url of my site you have to insert login details (.htaccess)
How can I scan it

10x
Logged

XML-Sitemaps Support

*
  • *****
  • 11782
Re: how to scan password protected sites
« Reply #1 on: May 25, 2009, 11:03:57 PM »
Hello,

you should allow accessing your website without login/password, since even if you will create a sitemap, Google will still NOT index your pages if thir bot is unable to open your pages.
Logged

sales499

*
  • *
  • 1
Re: how to scan password protected sites
« Reply #2 on: February 13, 2010, 10:53:32 PM »
I have same issue for [ External links are visible to forum administrators only ]
Only few pages have free access, all others are under user/password access.

Is it possible to provide the master user/password to your script so it can index the pages?
Logged

XML-Sitemaps Support

*
  • *****
  • 11782
Re: how to scan password protected sites
« Reply #3 on: February 14, 2010, 07:30:39 PM »
Please check the post above - even if you will include those links in sitemap, they still will NOT be indexed by search engines and their both will not be able to open them.
Logged
Pages: 1
« previous next »