When running runcrawl.php from command line, if the program stops for some reason, is there a way to restart from command line and save the urls that are already in crawl_dump.log? -- like the restart option on the "crawling" screen??
My crawl_dump.log is currently 260Mb and has 1.5 million lines.
I have already used the exclude config to keep it as small as I can.
Thanks
Mike