[GE users] Fw: maui-sge integration
hristo at mc.phys.uni-sofia.bg
Fri Oct 8 18:08:19 BST 2010
It seems that you are not following the state of the art in SGE's development.
It is possible to alter the node allocation policy to sequence number based one by altering the queue_sort_method in scheduler's configuration. You can also provide your own load computation formula if you keep the old load-based sorting algorithm.
SGE 6.x implements both fair share policy and functional share policy, and the scheduler can alter pending jobs' priority based on both historical usage data (with fair share policy on) and current machine usage (with functional share policy on). Fair share operates on a share tree (departments/projects/users) with allocated tickets, so you can distribute computational resources on whatever level suits you. You can also combine both policies. There is also support for projects with deadlines. And you can control how different job requirements influence it's priority (e.g. boost priority of pending multi-CPU tasks). In fact you can devise your own formula on how each priority-modifing component is weighted in the final priority value.
Not to mention the Resource Quota sets feature.
On 06.10.2010, at 8:19, aryana_178 wrote:
There are some special features in Maui. For instance, the administrator can choose different node allocation policies which may affect the overall performance. However in SGE, the only node allocation policy is the default one in which the node with minimum load is selected.
Another feature that i can mention is priority schemes. In Maui, there is a capability called fairshare which allows historical resource utilization information to be incorporated into job feasibility and priority decisions. Maui's fairshare implementation allows site administrators to set system utilization targets for users, groups, accounts, classes, and QOS levels.
And the last one! Backfilling is the heart of the overwhelming majority of schedulers which has 2 different types. The one which is implemented in most schedulers is EASY. However, as far as i concerned, the starvation phenomena is its drawback. In Maui, there is a parameter by which you can specify the number of times job is bypassed
by backfilling. The result will be preventing backfill based starvation.
There are some other great advantages that you can take of Maui. But this is not the right topic to talk about them.
I hope you can persuade me of SGE's advantages that prevent me from finding a way to integrate Maui and SGE.
To unsubscribe from this discussion, e-mail: [users-unsubscribe at gridengine.sunsource.net].
Dr Hristo Iliev
Monte Carlo research group
Faculty of Physics, University of Sofia
5 James Bourchier blvd, 1164 Sofia, Bulgaria
More information about the gridengine-users