Sitemap Generator Forum

Hi, can someone explain to me way is not adding to sitemap the urls?
Is there something wrong in my configuration?
Pages crawled: 9000 (482 added in sitemap), Queued: 7518, Depth level: 3
Thank you

Hello,

possibly those URLs are redirected to other pages or they have noindex robots meta tag.

Hi,
you are right in the log file i get this;
[ External links are visible to forum administrators only ] - lu - [ External links are visible to forum administrators only ]

but i am crawling the https site not the http and all shop is redirected to https from http.

Can you let me know if i can do something.
Thank you

Hello,

make sure that "Allow subdomains" setting is disabled, otherwise generator will crawl both http and https links.

I have try that, now seams to be ok, but still i have a 8000 page limit and i can generate that sitemap. Other limits are set to 0.
The Shop is in OC and there are a loot of url's to crawl but i can't even crawl this 8000 pages.
Can you please take a look it is possible that i have some bad settings .

Thank you

Hello,

please let me know your generator URL/login in private message to check this.