[GE users] Symmetrical parallel jobs

reuti reuti at staff.uni-marburg.de
Mon Dec 7 23:13:15 GMT 2009


Am 07.12.2009 um 21:30 schrieb mlelstv:

> On Mon, Dec 07, 2009 at 02:41:57PM -0500, cdwan wrote:
>
>> Failing that, is there a way to (a) make several PE's available to  
>> a job
>> and then (b) preferentially sort them?
>
> See sge_types(1):
>
> [...]
>  You can specify a PE name which  uses  the  wildcard  character,   
> "*".
>  Thus  the  request  "pvm*"  will match any parallel environment  
> with a
>  name starting with the string "pvm". In the case of multiple   
> parallel
>  environments  whose names match the name string, the parallel  
> environ-
>  ment with the most available slots is chosen.
> [...]
>
> Apparently the sorting done by SGE is what you want.

Correct, this is the way to do it. Small annotations:

- you will need PEs with fixed allocation rules for each combination,  
i.e. pvm2 => "allocation_rule 2", pvm4=> "allocation_rule 4", ...

- I think the original poster is looking for something like a  
"seq_no" inside the PEs to prefer pvm4 over pvm2, which is currently  
not available but an RFE:

http://gridengine.sunsource.net/issues/show_bug.cgi?id=1311

There is also another RFE to extend the $fill_up rule, but still  
might give you an odd distribution:

http://gridengine.sunsource.net/issues/show_bug.cgi?id=2332

Maybe there should be another allocation_rule $even with the same  
extension.  Meaning: give me the same on all hosts. Then you could  
specify $even:2 to avoid getting 3 on all machines. If more than one  
is listed, exactly these counts: $even:2,4,8,16

-- Reuti


>
> Greetings,
> -- 
>                                 Michael van Elst
> Internet: mlelstv at serpens.de
>                                 "A potential Snark may lurk in  
> every tree."
>
> ------------------------------------------------------
> http://gridengine.sunsource.net/ds/viewMessage.do? 
> dsForumId=38&dsMessageId=232084
>
> To unsubscribe from this discussion, e-mail: [users- 
> unsubscribe at gridengine.sunsource.net].

------------------------------------------------------
http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=38&dsMessageId=232113

To unsubscribe from this discussion, e-mail: [users-unsubscribe at gridengine.sunsource.net].



More information about the gridengine-users mailing list