missing link for many products
« on: March 05, 2014, 04:38:50 PM »
Hi,

I installed the "Unlimited PHP Sitemap Generator" on my server. My website is based on Magento and I have 9308 active and visible products. But, the generator generates a maximum of 1551 link. I tried to set the unlimited depth (all values ​​set to 0), but nothing changes. In the filters I set the following parameters (excluding URL):

filter
?p=
?limit
?dir
/media/catalog/
?___store=
?modellopouf
?pages_id
?materiale
/checkout/cart

How can I get links to all the products?

Thanks & Regards

Nicola
Re: missing link for many products
« Reply #1 on: March 06, 2014, 04:57:03 AM »
Hello,

could you please PM me your generator URL and an example URL that is not included in sitemap and how it can be reached starting from homepage?
 
Re: missing link for many products
« Reply #2 on: March 06, 2014, 07:47:25 AM »
[ External links are visible to forum administrators only ]


[ External links are visible to forum administrators only ] -->

Naviga tra i marchi (TOP PAGE) -->

KARMAN -->

page 4 ([ External links are visible to forum administrators only ]) -->

[ External links are visible to forum administrators only ]

« Last Edit: March 06, 2014, 07:52:58 AM by cristiano.group.srl »
Re: missing link for many products
« Reply #3 on: March 10, 2014, 07:09:11 AM »
Hello,

on karman.html?p=4 page you have this meta tag:
<link rel="canonical" href="[ External links are visible to logged in users only ]" />


it should be:
<link rel="canonical" href="[ External links are visible to logged in users only ]" />
Re: missing link for many products
« Reply #4 on: March 11, 2014, 09:39:40 AM »
Hi,

I applied a script that makes the canonical link ([ External links are visible to forum administrators only ]) and avoids redundant links indexed by google. I can not remove that script.

I disabled "enable canonical URLs" in "Detect canonical URL meta tags (advanced settings)". So the generator should not crash because of the canonical link.

How can I fix without removing my script?

Thanks & Regards.
Re: missing link for many products
« Reply #5 on: March 11, 2014, 01:20:43 PM »
From what I see, you have also added "?p=" in Exclude URLs setting, so generator doesn't crawl those pages.
Re: missing link for many products
« Reply #6 on: March 11, 2014, 09:15:32 PM »
Hi,

I removed "?p=" in "Exclude URLs setting" and has 10040 pages indexed. But in the sitemap there are thousands of duplicate link ([ External links are visible to forum administrators only ]). How do I remove it without losing the 10040 pages indexed?

Thanks & Regards
Re: missing link for many products
« Reply #7 on: March 12, 2014, 06:51:41 AM »
You can add this meta tag on those pages:
<meta name="robots" content="follow, noindex" />