Performance issue
« on: November 25, 2006, 07:40:40 PM »
Dears,
I have the standalone version.
Each time when I run it I'm getting an ServerLoad of over 18 !!!!!. (Ideally it shouldn't be >1)

I'm running on that server(AMD 64 4000+, 2GB)  about 50 domains with probably 100 concurrent users and getting a server load never over 1.0.

Running sitemap virtually shutting down the whole server.

Any ideas, work arounds - would love to run the sitemap via cron ...but,

Thanks for any hints,ideas, suggestions...
sloft

PS: Updated to the latest version today

« Last Edit: November 25, 2006, 07:49:53 PM by sloft »
Re: Performance issue
« Reply #1 on: November 25, 2006, 09:45:13 PM »
Hello,

you should use "Make a delay between requests" option of sitemap generator to slowdown the crawling speed (and correspondingly reduce server load).

Dears,
I have the standalone version.
Each time when I run it I'm getting an ServerLoad of over 18 !!!!!. (Ideally it shouldn't be >1)

I'm running on that server(AMD 64 4000+, 2GB)  about 50 domains with probably 100 concurrent users and getting a server load never over 1.0.

Running sitemap virtually shutting down the whole server.

Any ideas, work arounds - would love to run the sitemap via cron ...but,

Thanks for any hints,ideas, suggestions...
sloft

PS: Updated to the latest version today