Starts crawl, then Internal Server Error
« on: April 29, 2016, 09:26:28 AM »
Crawling starts, then after just over a minute, it stops and shows the "Internal Server Error" message.

I have increased memory and execution time as follows:
memory_limit = 512M;
max_execution_time = 120;

Should I increase those limits even more or are there any other settings I should change?

I have PM'd the URL and login in case you need to take a look.
Re: Starts crawl, then Internal Server Error
« Reply #1 on: April 30, 2016, 04:55:43 PM »
Hello,

you need to increase max_execution_time setting.
also,  in this case I would recommend to run generator in command line if you have ssh access to your server.
Re: Starts crawl, then Internal Server Error
« Reply #2 on: May 02, 2016, 12:00:57 PM »
I increased the limits in php.ini as follows but I'm getting the "Internal Server Error" message:

memory_limit = 1024M;
max_execution_time = 600;

I also ran the following as a test for a scheduled CRON job from the hosting control panel:

/usr/bin/php /home/sites/soccerbilia.co.uk/public_html/generator/runcrawl.php

... but the test failed. I don't have SSH access but i can apply to have this granted if necessary.

Re: Starts crawl, then Internal Server Error
« Reply #4 on: May 03, 2016, 11:21:52 AM »
Details from the email are in the attached text file.
Re: Starts crawl, then Internal Server Error
« Reply #5 on: May 04, 2016, 11:32:25 AM »
Looks like the process has been completed via the cron task:

<h4>Completed</h4>Total pages indexed: 7584
<br>Creating sitemaps...
Re: Starts crawl, then Internal Server Error
« Reply #6 on: May 05, 2016, 08:52:34 AM »
I didn't spot that, sorry! Many thanks for all your help :)