[GE users] scheduling with load averages ?

pvdmeer pvdmeer at gmail.com
Thu Jun 25 14:08:17 BST 2009


    [ The following text is in the "Windows-1252" character set. ]
    [ Your display is set for the "ISO-8859-10" character set.  ]
    [ Some special characters may be displayed incorrectly. ]

Hi!

The advantage is minimal, I agree. Often users can perform "manual scheduling". But SGE turned out to be quite easy to install, so we gave it a try. The cluster might grow in the near future, too.

With kind regards,

Pieter van der Meer

On Thu, Jun 25, 2009 at 3:01 PM, adary <adary at marvell.com<mailto:adary at marvell.com>> wrote:

This might sound like a flame, but I assure you it?s not:



What is the point of using SGE to manage a cluster of 32 cores?



I believe that managing something that small is easier by hand ?



________________________________

From: pvdmeer [mailto:pvdmeer at gmail.com<mailto:pvdmeer at gmail.com>]
Sent: Thursday, June 25, 2009 3:33 PM
To: users at gridengine.sunsource.net<mailto:users at gridengine.sunsource.net>
Subject: Re: [GE users] scheduling with load averages ?



Well well..

load_formula np_load_average

in the scheduler configuration seems to have done the trick ;)

With kind regards,

Pieter van der Meer

On Thu, Jun 25, 2009 at 1:56 PM, Pieter van der Meer <pvdmeer at gmail.com<mailto:pvdmeer at gmail.com>> wrote:

Dear SGE users,

Recently, we got our cluster (4 nodes, 8 cores each) running Grid Engine 6.2u2. I configured SGE to use the following scheduler configuration settings:

queue_sort_method                 load

load_formula                      slots

I set the amount of slots in the queue to 8, and this seems to work fantastic. The cluster is loaded in a very balanced way. Nodes are filled up with one process for one core. This is what we'd like to see.

So far, so good. But what happens when people start running jobs without SGE? Of course, we'd like to limit this as much as possible. But at this moment, we can't avoid it. It seems that "qstat" is aware of host load averages. The metric would be a good scheduling rule, I'd say.. Does anyone know if this is an option with SGE 6.2u2?

Thanks in advance,

Pieter van der Meer








More information about the gridengine-users mailing list