I have been getting errors when crawling my site. From checking the forums I guess it is because of limitations on my server and I noticed that some were recommending to crawl it manually from a different server.
Are there instructions for doing this?