[GE users] limiting # of assigned jobs to host (in all queues)

craffi dag at sonsorol.org
Fri May 29 18:47:14 BST 2009


Hit the grid engine docs on wikis.sun.com and look for information on  
"user requestable consumable resources"

There are a few ways to get the behavior you want but one of the best  
practice ways would be:

- Create a new custom entry in the SGE complex (what you see when you  
type "qconf -sc")
- Make this new entry (a) requestable and (b) consumable with a  
default value of 0
- Configure your hosts via the complex_values parameter so that they  
have "gpuCard=1" or whatever

Then submit your jobs to any queue with an extra resource request  
asking for the special hardware:

$ qsub -hard -l gpuCard ./myJobscript.sh


There are other ways to do this but the consumable resource method  
will work when you have an arbitrary number of queues because there  
will only be '1' of these special consumable entities attached to each  
host.

-Chris



On May 29, 2009, at 1:06 PM, cjf001 wrote:

> Guys, I think I may be missing something basic here, but I can't see  
> how
> to resolve this....
>
> I have a set of machines (a hostgroup), each machine of which has a  
> special
> piece of hardware attached to it - this hardware (really just a  
> graphics card)
> is where the simulation work is really done. Since there's only one of
> these pieces of hardware attached to each machine, each machine can  
> only
> support one job at a time.
>
> OK, easy so far, right ?  Well, the machines in this hostgroup  
> happen to
> have quad-core processors. So, the # of CPUs reported to the sge  
> master
> for each machine is 4. BUTTTTTT - I need to limit SGE to assigning  
> just
> one job at a time to each machine - how do I do that ?
>
> I have 2 cluster queues, and in each of them I modified the # of slots
> variable for this hostgroup to "1" (the default was 4). However,  
> when I
> test it, SGE assigns a job to both queues on a single machine - but  
> I need
> it to somehow realize that there's only 1 slot available on the entire
> machine....  I'm stumped ...  Is there something easy to configure  
> that I'm
> missing, or do I need to do something "special" or "complex" ?
>
>    Thanks !
>
>       John
>
>
>
> -- 
> ###########################################################################
> # John Foley                          # Location:  IL93- 
> E1-21S            #
> # IT & Systems Administration         # Maildrop:  IL93- 
> E1-35O            #
> # Antenna & Mechanical Simulation Grp #    Email: john.foley at motorola.com 
>  #
> # Motorola, Inc. -  Mobile Devices    #    Phone: (847)  
> 523-8719          #
> # 600 North US Highway 45             #      Fax: (847)  
> 523-5767          #
> # Libertyville, IL. 60048  (USA)      #     Cell: (847)  
> 460-8719          #
> ###########################################################################
>                 (this email sent using Mozilla on Windows)
>
> ------------------------------------------------------
> http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=38&dsMessageId=199722
>
> To unsubscribe from this discussion, e-mail: [users-unsubscribe at gridengine.sunsource.net 
> ].

------------------------------------------------------
http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=38&dsMessageId=199728

To unsubscribe from this discussion, e-mail: [users-unsubscribe at gridengine.sunsource.net].



More information about the gridengine-users mailing list