[GE users] Queue configuration

Noé Vázquez González nvazquezg at gmail.com
Thu May 15 16:56:50 BST 2008


    [ The following text is in the "ISO-8859-1" character set. ]
    [ Your display is set for the "ISO-8859-10" character set.  ]
    [ Some special characters may be displayed incorrectly. ]

Hi,

Sorry, I wasn't referring to parallell MPI jobs but sequential jobs that
need more than one CPU (OpenMP). In PBS is done setting the resources NODE
and PPN, for example "node = 1: PPN = 4" to reserve 4 cpus from 1 node. I'm
sure it can be done with SGE but I don't know how...

Thanks,

Noé


2008/5/15 Reuti <reuti at staff.uni-marburg.de>:

> Hi,
>
> Am 14.05.2008 um 22:01 schrieb Noé Vázquez González:
>
>  I'm still trying to set up the queues without success :(
>>
>> I want to run a job only if there are enough free cpus on a single host,
>> just waiting if there aren't enough free cpus on a single node.
>>
>
> then you might want the "allocation_rule $pe_slots". Then all slots must be
> on one and the same node.
>
> To avoid starvation of a parallel job, I suggest to turn on reservation by
> a sensible setting in the scheduler configuration for "max_reservation" and
> submit the jobs with "-R y".
>
> -- Reuti
>
>
>
>  Any hints?
>>
>> Thanks
>>
>> Noé
>>
>> 2008/5/7 Erik Soyez <E.Soyez at science-computing.de>:
>> Good Morning Noé,
>>
>> a PE "allocation_rule" of "$fill_up" should almost do the job.
>> But if there was, for example, one host with 8 free cpus and
>> some load and two hosts with 4 free cpus each and no load the
>> job would spread over the two hosts with lower load - I think.
>>
>> To be sure:  Set up two queues smp and dmp, give the smp queue
>> a lower sequence number, configure seqno as sort_method, add the
>> two PEs pe_smp and pe_dmp to the corresponding queues and make
>> their allocation_rules $pe_slots and $_fill_up respectively.
>>
>> Qsub your job with "-pe pe_\* 8".
>>
>> Erik Soyez.
>>
>>
>>
>> On Tue, 6 May 2008, Noé Vázquez González wrote:
>>
>> Hi All,
>>
>> Is it possible to set up a parallel queue as follows?
>>  - If a node has enough free cpus for the job, run it on that node.
>>  - If there isn't a node with enough free cpus, spread the job between the
>> nodes as usual.
>>
>> For example, a parallel job that requires 8 cpus, if there is a node with
>> 8
>> free cpus asign the job to 8 cpus of that node. If there isn't 8 cpus
>> avaliable on the same node, spread the job between other nodes as usual
>> depending on their load (4 4, 2 2 2 2, etc.)
>>
>> Thanks.
>>
>> Noé
>>
>>
>> --
>> --
>> Vorstand/Board of Management:
>> Dr. Bernd Finkbeiner, Dr. Florian Geyer,
>> Dr. Roland Niemeier, Dr. Arno Steitz, Dr. Ingrid Zech
>> Vorsitzender des Aufsichtsrats/
>> Chairman of the Supervisory Board:
>> Prof. Dr. Hanns Ruder
>> Sitz/Registered Office: Tuebingen
>> Registergericht/Registration Court: Stuttgart
>> Registernummer/Commercial Register No.: HRB 382196
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: users-unsubscribe at gridengine.sunsource.net
>> For additional commands, e-mail: users-help at gridengine.sunsource.net
>>
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe at gridengine.sunsource.net
> For additional commands, e-mail: users-help at gridengine.sunsource.net
>
>



More information about the gridengine-users mailing list