[GE users] scheduler priority questions

Reuti reuti at staff.uni-marburg.de
Tue May 8 23:37:21 BST 2007


Hi,

Am 08.05.2007 um 01:20 schrieb Mike Packard:

> Hello All,
>
> I am confused about some scheduler behavior and thought maybe you  
> guys might be
> able to help.  I'm using sge 6.0u6.   First, I'm seeing jobs run  
> before other
> jobs of higher priority.  For example:
>
> job-ID prior name user state submit/start at queue slots ja-task-ID
> -------------------------------------------------------------------
> 12927 0.50000 job01 user01 r 05/03/2007 09:26:43 all.q at node01 32
> 13026 0.50000 job04 user04 r 05/08/2007 00:59:08 all.q at node31 16  ?
> 12998 100.51000 job02 user02 qw 05/06/2007 09:49:06 124
> 12988 70.06522 job03 user03 qw 05/04/2007 14:38:42 96
>
> Job04 was submitted after job02 & job03 and has a much lower  
> priority, but it
> still started first.  I assume it was because gridengine saw that  
> there were
> enough free nodes, but I keep having the problem that larger jobs  
> get preempted
> by smaller jobs and then never run.  Ideally I would like the  
> scheduler to reserve the
> nodes for the largest jobs first and then backfill around them with  
> smaller
> jobs.
>
> Might this be a result of not having any h_rt limits enforced?

did you enable resource reservation, i.e. submitted the jobs with "-R  
y" and the scheduler setting like "max_reservation 64"?

The specified h_rt will be used for backfilling of already reserved  
resources, and should be set to a sensible value. If left out, the  
"default_duration" from the scheduler configuration will be used.  
Unfortunately there is no "suggested runtime" without enforcing the  
hardlimit h_rt for now.

> Another question:
> I would like one user to always have top priority; i.e. all other jobs
> will always be scheduled behind this one user's jobs.  Is there a  
> good way to do
> this?

Maybe a dedicated queue for only this user (set user_lists) and the  
necessity to request a complex (i.e. FORCED) to use it which has a  
high urgency value.

-- Reuti

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe at gridengine.sunsource.net
For additional commands, e-mail: users-help at gridengine.sunsource.net




More information about the gridengine-users mailing list