Need help to generate sitemap for "Virtual" pages
« on: December 12, 2014, 12:06:06 AM »
I am putting together a site that takes data from Google API.

There is virtually ONE page but behind each query are thousands (hundreds of thousands) of result pages. 

In this example, the jump page is all-city.  The location specified is Albuquerque, NM - and the type of business is Bail Bonds.

[ External links are visible to forum administrators only ] Bonds

There can be several cities (10,000 in the U.S.) and several business types.

I am able to come up with a text file with all the links but I am not able to make XML-Sitemap generator crawl all these pages from the main jump page.

How can I get these search links into my sitemap?

Since there are 10,000 plus entries, is the sitemap going to be partitioned for speed?

Please advise.

Re: Need help to generate sitemap for "Virtual" pages
« Reply #1 on: December 12, 2014, 05:22:28 AM »
Hello,

the pages will be crawled fine if you have links to results like <a href="?action=result&location=Albuquerque,NM&btype=Bail">.

Sitemap generator will split sitemap on multiple files if needed.
Re: Need help to generate sitemap for "Virtual" pages
« Reply #2 on: December 12, 2014, 09:00:31 AM »
I have a bit of a problem because I am using wordpress multisite.  The site that I am running this on is not really on a physical subdirectory off the root domain. 

It is a subdirectory site to Wordpress multi site.  Wordpress is not able to include the "virtual" links because it only does actual pages and posts.

The link below is where I have this "virtual page" script running.  This page contains the links out to the cities which subsequently link out the the city and business type (from the same page)

[ External links are visible to forum administrators only ]

I may have put the XML script wrong - in a folder of the root directory?  Is there a tutorial video I can follow through?
Re: Need help to generate sitemap for "Virtual" pages
« Reply #3 on: December 12, 2014, 02:11:18 PM »
Hello,

from what I see if you will put a link to /city/ from homepage, generator should be able to crawl it.
Re: Need help to generate sitemap for "Virtual" pages
« Reply #4 on: December 12, 2014, 08:14:33 PM »
I did try the free version of XML-Sitemap generator but not V5.3 yet. The free version results were not encouraging that is why I am asking. 

I entered [ External links are visible to forum administrators only ]  - which should have been the same as putting a link on the homepage.

BTW here is the content of free version XML and it only picked up 2 of the launch pages - non of the virtual pages?

<?xml version="1.0" encoding="UTF-8"?>
<urlset
      xmlns="[ External links are visible to forum administrators only ]"
      xmlns:xsi="[ External links are visible to forum administrators only ]"
      xsi:schemaLocation="[ External links are visible to forum administrators only ]
            [ External links are visible to forum administrators only ]">
<!-- created with Free Online Sitemap Generator www.xml-sitemaps.com -->

<url>
  <loc>[ External links are visible to forum administrators only ]</loc>
</url>
<url>
  <loc>[ External links are visible to forum administrators only ]</loc>
</url>
</urlset>

My understanding is that the free version has a limit of 500 and the paid version has more.  I was hoping the free version would crawl at least 500 virtual pages and stop.
Re: Need help to generate sitemap for "Virtual" pages
« Reply #7 on: December 17, 2014, 02:54:10 AM »
I see the "no follow" attribute now.  Unfortunately, I have no access to the encrypted code. 

Is there a way that I can generate a sitemap based on naked URL?

I know hundreds of virtual pages - of cities for this site like:

[ External links are visible to forum administrators only ]

Only the city names change on the URL.

Please advise.

Re: Need help to generate sitemap for "Virtual" pages
« Reply #8 on: December 17, 2014, 05:36:02 AM »
Hello,

you'd need to create an html page for that with simple links like:
<a href="link_1"></a>
<a href="link_2"></a>
..
Re: Need help to generate sitemap for "Virtual" pages
« Reply #9 on: May 24, 2015, 10:29:19 AM »
Hi,

I probably have a similar script that generates output as htm/html pages or directories. Did you get the Sitemap Generator to work with your code?

How do you challenge Google API limitations for querries?

Thanks
poleca