I have been trying to get this to run for the last two days, both manually and by letting it run interrupted in the background and I'm getting nowhere. This is a fairly large forum site, so there are a lot of pages to crawl, but right now everytime I run it it goes through around 100 pages and comes back with this 500 error. I thought it might be a memory issue, so I increased the memory limits for the server, but I still get the same results. What can I do?
Guest