[GE users] Fw: maui-sge integration

reuti reuti at staff.uni-marburg.de
Fri Oct 8 19:13:58 BST 2010

Am 08.10.2010 um 19:18 schrieb kennethsdsc:

> I thought bypass count priority was no longer in Maui.
> SHORTPOOL was also a great feature that Maui had at
> one time.
> I tried to integrate an external scheduler with GE a while
> back.  At that time, GDI was the only interface, and that
> was really only for internal components of GE to talk
> to each other.  Does GE have a documented API now?

No. It was announced at one time but never realized. Some tried JMX instead:


-- Reuti

> On Fri, 8 Oct 2010, icaci wrote:
>> Date: Fri, 8 Oct 2010 20:08:19 +0300
>> From: icaci <hristo at mc.phys.uni-sofia.bg>
>> Reply-To: users <users at gridengine.sunsource.net>
>> To: users at gridengine.sunsource.net
>> Subject: Re: [GE users] Fw: maui-sge integration
>> Hi,
>> It seems that you are not following the state of the art in SGE's development.
>> It is possible to alter the node allocation policy to sequence number based one by altering the queue_sort_method in scheduler's configuration. You can also provide your own load computation formula if you keep the old load-based sorting algorithm.
>> SGE 6.x implements both fair share policy and functional share policy, and the scheduler can alter pending jobs' priority based on both historical usage data (with fair share policy on) and current machine usage (with functional share policy on). Fair share operates on a share tree (departments/projects/users) with allocated tickets, so you can distribute computational resources on whatever level suits you. You can also combine both policies. There is also support for projects with deadlines. And you can control how different job requirements influence it's priority (e.g. boost priority of pending multi-CPU tasks). In fact you can devise your own formula on how each priority-modifing component is weighted in the final priority value.
>> Not to mention the Resource Quota sets feature.
>> -- Hristo
>> On 06.10.2010, at 8:19, aryana_178 wrote:
>>> There are some special features in Maui. For instance, the administrator can choose different node allocation policies which may affect the overall performance. However in SGE, the only node allocation policy is the default one in which the node with minimum load is selected.
>>> Another feature that i can mention is priority schemes. In Maui, there is a capability called fairshare which allows historical resource utilization information to be incorporated into job feasibility and priority decisions. Maui's fairshare implementation allows site administrators to set system utilization targets for users, groups, accounts, classes, and QOS levels.
>>> And the last one! Backfilling is the heart of the overwhelming majority of schedulers which has 2 different types. The one which is implemented in  most schedulers is EASY. However, as far as i concerned, the starvation phenomena is its drawback. In  Maui, there is a parameter by which you can specify the number of times job is bypassed
>>> by backfilling. The result will be preventing backfill based starvation.
>>> There are some other great advantages that you can take of  Maui. But this is not the right topic to talk about them.
>>> I hope you can persuade me of SGE's advantages that prevent me from finding a way to integrate Maui and SGE.
>>> ------------------------------------------------------
>>> http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=38&dsMessageId=286090
>>> To unsubscribe from this discussion, e-mail: [users-unsubscribe at gridengine.sunsource.net].
>> --
>> Dr Hristo Iliev
>> Monte Carlo research group
>> Faculty of Physics, University of Sofia
>> 5 James Bourchier blvd, 1164 Sofia, Bulgaria
>> http://cluster.phys.uni-sofia.bg/hristo/
>> ------------------------------------------------------
>> http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=38&dsMessageId=286447
>> To unsubscribe from this discussion, e-mail: [users-unsubscribe at gridengine.sunsource.net].
> ------------------------------------------------------
> http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=38&dsMessageId=286448
> To unsubscribe from this discussion, e-mail: [users-unsubscribe at gridengine.sunsource.net].


To unsubscribe from this discussion, e-mail: [users-unsubscribe at gridengine.sunsource.net].

More information about the gridengine-users mailing list