[GE users] multiplied resource limits with pe

Reuti reuti at staff.uni-marburg.de
Thu Aug 24 20:35:05 BST 2006


Hi,

Am 24.08.2006 um 20:24 schrieb SLIM H.A.:

>
> I am puzzled by a similar problem with a consumable resource, a 800GB
> disk attached to a 8 way node.
> This is the setup:
>
> qconf -sc = the consumable:
> #name               shortcut       type        relop requestable
> consumable default  urgency
> #--------------------------------------------------------------------- 
> --
> ---------------------
> bigtmpoctet        bigtmpoctet    MEMORY      <=    FORCED      YES
> 0G       0
>
> qconf -sq octet.q = the queue
> qname                 octet.q
> hostlist              @octets
> ...
> pe_list               mpich openmp
> ...
> complex_values        bigtmpoctet=800G
> ...
>
> qconf -sp openmp = PE to use
> pe_name           openmp
> slots             16
> ...
>
> Now if I submit a job requesting 100G and 4 slots from the openmp PE,
>
> qsub -q octet.q -pe openmp 4 -l bigtmpoctet=100G script
>
> it runs but when checking the amount of free consumable diskspace  
> before
> and after start of the job I get:
>
> qstat -q octet.q -F bigtmpoctet = before
> queuename                      qtype used/tot. load_avg arch
> states
> ---------------------------------------------------------------------- 
> --
> ----
> octet.q at octet01.hamilton.dur.a BP    8/16      5.12     lx26-amd64
>         hc:bigtmpoctet=792.549G
>
> qstat -q octet.q -F bigtmpoctet = after
> queuename                      qtype used/tot. load_avg arch
> states
> ---------------------------------------------------------------------- 
> --
> ----
> octet.q at octet01.hamilton.dur.a BP    12/16     4.87     lx26-amd64
>         hc:bigtmpoctet=392.549G
>
> The consumable has been decreased by 4 x 100GB, which is not right,  
> so I
> advise users to divide the actual amount of disk they want by the  
> number
> of slots (usually 4 as in this case) to get the correct bookkeeping.
>
> Any suggestions what parameters I should change to avoid the fiddling
> with division by number of slots?

for now there is no workaround besides dividing the resource request  
before the submit. There is a similar issue:

http://gridengine.sunsource.net/issues/show_bug.cgi?id=1254

for this. I'll extend it to include resource requests.

-- Reuti

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe at gridengine.sunsource.net
For additional commands, e-mail: users-help at gridengine.sunsource.net




More information about the gridengine-users mailing list