Is it possible to add an option to automatically resume crawling if the script is interrupted?
Such as if the script is interrupted any other way then manually terminating the process. This would be useful on hosts that impose a time limit on how long a single php script can run. In my case my host allows 30 seconds for php scripts before they are terminated.
Guest