Hey,
our website is hosted on a dedicated webserver (PHP 8.1.28, Apache, 8 GB RAM, ~40 GB free disk space).
Sitemap Generator is limited by an execution time. So it needs some days to generate all sitemap files. Sitemap generator is started by cron. In some cases the server crashes. Sitemap Generator seems to write to disk and claims all free disk space.
Our website has ~70.000 pages.
The ouput of our cron is redirected to /dev/null.
0 0 * * * php /var/www/sitemapgen/runcrawl.php > /dev/null 2>&1
Sitemap Generator produces a lot of Warnings:
PHP Deprecated: trim():Passing null to parameter #1 ($string) of type string is deprecated in /var/www/sitemapgen/pages/class.http.inc.php on line 126
PHP Warning: Undefined array key "req" in /var/www/sitemapgen/pages/class.http.inc.php on line 120
PHP Warning: Undefined array key "xs_crawl_ident" in /var/www/sitemapgen/pages/class.http.inc.php on line 115
PHP Warning: Undefined array key "xs_http_nogzip" in /var/www/sitemapgen/pages/class.http.inc.php on line 121
PHP Warning: Undefined array key "addheaders" in /var/www/sitemapgen/pages/class.http.inc.php on line 121
PHP Warning: Undefined array key "xs_keep_alive" in /var/www/sitemapgen/pages/class.http.inc.php on line 121
PHP Warning: Undefined array key "ddbg3" in /var/www/sitemapgen/pages/class.utils.inc.php on line 107
PHP Warning: Undefined array key "ddbg" in /var/www/sitemapgen/pages/class.utils.inc.php on line 107
PHP Warning: Undefined array key "ddbg3" in /var/www/sitemapgen/pages/class.utils.inc.php on line 107
We assume that warnings could be stored to disk and force the server to crash.
After the server crashed the disk space is freed.
Credentials to our site ain't possible.
What could cause our trouble? How can we fix it?
Sincerely info2593
Guest