Tools for Any SEO Challenge: Get more traffic to your website with versatile solutions for every step of your SEO journey.
« previous next »
Pages: 1

wcb1

*
  • *
  • 2
Crawling freezes website - cannot acces site
« on: June 23, 2011, 05:18:44 PM »
Every time I run the crawler my site becomes completely inaccessible - I have tried various settings and I have tried setting the delay to 2s delay every 4 requests and still it freezes my site.

My server has plenty of RAM.

When the crawler runs - no pages on the website load - nothing!
Logged

wcb1

*
  • *
  • 2
Re: Crawling freezes website - cannot acces site
« Reply #1 on: June 23, 2011, 06:01:52 PM »
well... i just installed the update to verison 5.0 and now it doesn't seem to freeze !! wahay!
But i will wait and see if this is a one off or not - because with version 4 it would sometimes not freeze up my site and sometiems it would.. seemingly random.

so i will post back here soon.
Logged
Pages: 1
« previous next »