I am not sure if there is a problem with the script or my site.
I recently changed over from a static HTML site to one that includes dynamic PHP content. Let's say the home page is [ External links are visible to forum administrators only ]. The script starts to crawl, but no URLs are returned. However when I rename the home page to index.htm it crawls hundreds of pages but only lists those with a .htm extension and none with a .php extension.
Ideas?
Guest