Competitor Analysis Tool: Analyze rival websites and gain valuable SEO and PPC insights
« previous next »
Pages: 1

dorine

*
  • *
  • 2
Crawl error IDN domain name
« on: July 21, 2013, 03:23:47 PM »
Hi there,

I am trying do crawl the domain lumièredujour.fr.
I set the start URL to [ External links are visible to forum administrators only ] and then i get this error:

Quote
There was an error while retrieving the URL specified: [ External links are visible to forum administrators only ]
HTTP Code:
HTTP/1.1 302 Found
HTTP headers:
date: Sun, 21 Jul 2013 14:11:07 GMT
server: Apache/2
location: [ External links are visible to forum administrators only ]
content-length: 294
connection: close
content-type: text/html; charset=iso-8859-1
x_csize: 294

HTTP output:
302 Found

Is this a website/server configuration error or a Sitemap Generator bug?
Logged

XML-Sitemaps Support

*
  • *****
  • 11780
Re: Crawl error IDN domain name
« Reply #1 on: July 23, 2013, 06:31:14 AM »
Hello,

looks like you have specified xn--lumiredujour-0db.fr/  as starting URL instead of [ External links are visible to logged in users only ]
Logged

dorine

*
  • *
  • 2
Re: Crawl error IDN domain name
« Reply #2 on: July 23, 2013, 09:38:07 AM »
The www did the trick but i don't understand why?
In my .htaccess non www is redirected to www....
Logged

XML-Sitemaps Support

*
  • *****
  • 11780
Re: Crawl error IDN domain name
« Reply #3 on: July 26, 2013, 07:47:27 AM »
Starting URL must be matching the resulting domain of the website.
Logged
Pages: 1
« previous next »