[GE users] scheduling with load averages ?

adary adary at marvell.com
Thu Jun 25 14:01:59 BST 2009


    [ The following text is in the "Windows-1252" character set. ]
    [ Your display is set for the "ISO-8859-10" character set.  ]
    [ Some special characters may be displayed incorrectly. ]

This might sound like a flame, but I assure you it?s not:

What is the point of using SGE to manage a cluster of 32 cores?

I believe that managing something that small is easier by hand ?

________________________________
From: pvdmeer [mailto:pvdmeer at gmail.com]
Sent: Thursday, June 25, 2009 3:33 PM
To: users at gridengine.sunsource.net
Subject: Re: [GE users] scheduling with load averages ?

Well well..

load_formula np_load_average

in the scheduler configuration seems to have done the trick ;)

With kind regards,

Pieter van der Meer
On Thu, Jun 25, 2009 at 1:56 PM, Pieter van der Meer <pvdmeer at gmail.com<mailto:pvdmeer at gmail.com>> wrote:
Dear SGE users,

Recently, we got our cluster (4 nodes, 8 cores each) running Grid Engine 6.2u2. I configured SGE to use the following scheduler configuration settings:

queue_sort_method                 load

load_formula                      slots

I set the amount of slots in the queue to 8, and this seems to work fantastic. The cluster is loaded in a very balanced way. Nodes are filled up with one process for one core. This is what we'd like to see.

So far, so good. But what happens when people start running jobs without SGE? Of course, we'd like to limit this as much as possible. But at this moment, we can't avoid it. It seems that "qstat" is aware of host load averages. The metric would be a good scheduling rule, I'd say.. Does anyone know if this is an option with SGE 6.2u2?

Thanks in advance,

Pieter van der Meer






More information about the gridengine-users mailing list