Opened 7 years ago

Last modified 7 years ago

#1425 new enhancement

implement PE sorting

Reported by: dlove Owned by:
Priority: normal Milestone:
Component: sge Version: 8.1.0
Severity: minor Keywords:
Cc:

Description

Sorting PEs lexically is probably straightforward and useful:
http://gridengine.eu/grid-engine-internals/106-univa-grid-engine-81-enhancement-part-6-configure-the-parallel-environment-pe-selection-order-2012-06-09

Random ordering might also be useful, say, applied to a set of
otherwise-equivalent PEs for connectivity islands.

Change History (3)

comment:1 Changed 7 years ago by m.c.dixon@…

On Thu, 12 Jul 2012, SGE wrote:

#1425: implement PE sorting


Reporter: dlove | Type: enhancement

Status: new | Priority: normal

Component: sge | Version: 8.1.0
Severity: minor |


Sorting PEs lexically is probably straightforward and useful:
http://gridengine.eu/grid-engine-internals/106-univa-grid-engine-81
-enhancement-part-6-configure-the-parallel-environment-pe-selection-
order-2012-06-09

Random ordering might also be useful, say, applied to a set of
otherwise-equivalent PEs for connectivity islands.

I looked at the relevant bit of scheduler code some months ago. I think it already sorts PEs, but in order of utilisation (most free PE comes first).

It would be helpful if this enhancement had an option to sort PEs such that the least free comes first.

This would come in useful if you had a number of PEs to reflect your interconnect topology: it would pack jobs onto the most used islands of your interconnect, leaving larger chunks free for scheduling larger jobs.

Mark
--


Mark Dixon Email : m.c.dixon@…
HPC/Grid Systems Support Tel (int): 35429
Information Systems Services Tel (ext): +44(0)113 343 5429
University of Leeds, LS2 9JT, UK


comment:2 Changed 7 years ago by dlove

Mark Dixon <m.c.dixon@…> writes:

I looked at the relevant bit of scheduler code some months ago. I
think it already sorts PEs, but in order of utilisation (most free PE
comes first).

Yes. [That may not be working and/or interacting with reservation
correctly (#1354).] I can't remember where it would go off-hand, and I
think there two or three sites to check, so someone else may be better
placed to implement it.

It would be helpful if this enhancement had an option to sort PEs such
that the least free comes first.

This would come in useful if you had a number of PEs to reflect your
interconnect topology: it would pack jobs onto the most used islands
of your interconnect, leaving larger chunks free for scheduling larger
jobs.

Right. I assume it needs a PE load formula, with resources for PEs
rather than hosts, if that's not too expensive.

comment:3 Changed 7 years ago by m.c.dixon@…

On Wed, 18 Jul 2012, SGE wrote:
...

Yes. [That may not be working and/or interacting with reservation
correctly (#1354).] I can't remember where it would go off-hand, and I
think there two or three sites to check, so someone else may be better
placed to implement it.

...

I was intending to take a look for my own purposes, when I had time. Unfortunately, I've got a new cluster being comissioned so I don't know when I'll get to it.

Right. I assume it needs a PE load formula, with resources for PEs
rather than hosts, if that's not too expensive.

...

Not sure.

Mark
--


Mark Dixon Email : m.c.dixon@…
HPC/Grid Systems Support Tel (int): 35429
Information Systems Services Tel (ext): +44(0)113 343 5429
University of Leeds, LS2 9JT, UK


Note: See TracTickets for help on using tickets.