[GE users] limiting # of assigned jobs to host (in all queues)

cjf001 john.foley at motorola.com
Fri May 29 19:18:03 BST 2009


Thanks - exactly what I ended up doing !  Good to know that I'm not
off-base, doing something crazy.... ;)

     John


craffi wrote:

> Hit the grid engine docs on wikis.sun.com and look for information on  
> "user requestable consumable resources"
> 
> There are a few ways to get the behavior you want but one of the best  
> practice ways would be:
> 
> - Create a new custom entry in the SGE complex (what you see when you  
> type "qconf -sc")
> - Make this new entry (a) requestable and (b) consumable with a  
> default value of 0
> - Configure your hosts via the complex_values parameter so that they  
> have "gpuCard=1" or whatever
> 
> Then submit your jobs to any queue with an extra resource request  
> asking for the special hardware:
> 
> $ qsub -hard -l gpuCard ./myJobscript.sh
> 
> 
> There are other ways to do this but the consumable resource method  
> will work when you have an arbitrary number of queues because there  
> will only be '1' of these special consumable entities attached to each  
> host.
> 
> -Chris
> 
> 
> 
> On May 29, 2009, at 1:06 PM, cjf001 wrote:
> 
> 
>>Guys, I think I may be missing something basic here, but I can't see  
>>how
>>to resolve this....
>>
>>I have a set of machines (a hostgroup), each machine of which has a  
>>special
>>piece of hardware attached to it - this hardware (really just a  
>>graphics card)
>>is where the simulation work is really done. Since there's only one of
>>these pieces of hardware attached to each machine, each machine can  
>>only
>>support one job at a time.
>>
>>OK, easy so far, right ?  Well, the machines in this hostgroup  
>>happen to
>>have quad-core processors. So, the # of CPUs reported to the sge  
>>master
>>for each machine is 4. BUTTTTTT - I need to limit SGE to assigning  
>>just
>>one job at a time to each machine - how do I do that ?
>>
>>I have 2 cluster queues, and in each of them I modified the # of slots
>>variable for this hostgroup to "1" (the default was 4). However,  
>>when I
>>test it, SGE assigns a job to both queues on a single machine - but  
>>I need
>>it to somehow realize that there's only 1 slot available on the entire
>>machine....  I'm stumped ...  Is there something easy to configure  
>>that I'm
>>missing, or do I need to do something "special" or "complex" ?
>>
>>   Thanks !
>>
>>      John
>>
>>
>>
>>-- 
>>###########################################################################
>># John Foley                          # Location:  IL93- 
>>E1-21S            #
>># IT & Systems Administration         # Maildrop:  IL93- 
>>E1-35O            #
>># Antenna & Mechanical Simulation Grp #    Email: john.foley at motorola.com 
>> #
>># Motorola, Inc. -  Mobile Devices    #    Phone: (847)  
>>523-8719          #
>># 600 North US Highway 45             #      Fax: (847)  
>>523-5767          #
>># Libertyville, IL. 60048  (USA)      #     Cell: (847)  
>>460-8719          #
>>###########################################################################
>>                (this email sent using Mozilla on Windows)
>>
>>------------------------------------------------------
>>http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=38&dsMessageId=199722
>>
>>To unsubscribe from this discussion, e-mail: [users-unsubscribe at gridengine.sunsource.net 
>>].
> 
> 
> ------------------------------------------------------
> http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=38&dsMessageId=199728
> 
> To unsubscribe from this discussion, e-mail: [users-unsubscribe at gridengine.sunsource.net].



-- 
###########################################################################
# John Foley                          # Location:  IL93-E1-21S            #
# IT & Systems Administration         # Maildrop:  IL93-E1-35O            #
# Antenna & Mechanical Simulation Grp #    Email: john.foley at motorola.com #
# Motorola, Inc. -  Mobile Devices    #    Phone: (847) 523-8719          #
# 600 North US Highway 45             #      Fax: (847) 523-5767          #
# Libertyville, IL. 60048  (USA)      #     Cell: (847) 460-8719          #
###########################################################################
                 (this email sent using Mozilla on Windows)

------------------------------------------------------
http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=38&dsMessageId=199732

To unsubscribe from this discussion, e-mail: [users-unsubscribe at gridengine.sunsource.net].



More information about the gridengine-users mailing list