[GE users] virtual_free as consumable resource

bwillems b-willems at northwestern.edu
Fri Feb 20 16:05:27 GMT 2009


Hi Reuti,

this indeed solved the problem.

Thanks!
Bart

> Hi,
>
> Am 19.02.2009 um 23:04 schrieb bwillems:
>
>> I am trying to set up limits on memory usage by SGE jobs following the
>> guidelines at
>>
>> http://wikis.sun.com/display/GridEngine/Configuring+Complex+Resource
>> +Attributes
>>
>> So I have defined virtual_free as a consumable complex attribute
>> with a
>> default value of 1G:
>>
>> [root at fugu ~]# qconf -sc
>> ...
>> virtual_free        vf         MEMORY      <=    YES
>> YES        1G
>>       0
>> ...
>>
>> I also set virtual_free equal to the total available physics memory on
>> each node, e.g.
>>
>> [root at fugu ~]# qconf -se compute-0-20.local
>> hostname              compute-0-20.local
>> load_scaling          NONE
>> complex_values        slots=4,virtual_free=8G
>> load_values           arch=lx24-
>> amd64,num_proc=4,mem_total=7990.878906M, \
>>
>> swap_total=996.207031M,virtual_total=8987.085938M, \
>> load_avg=4.040000,load_short=4.010000, \
>>                       load_medium=4.040000,load_long=4.000000, \
>>                       mem_free=5591.191406M,swap_free=996.117188M, \
>> virtual_free=6587.308594M,mem_used=2399.687500M, \
>> swap_used=0.089844M,virtual_used=2399.777344M, \
>> cpu=100.000000,np_load_avg=1.010000, \
>>
>> np_load_short=1.002500,np_load_medium=1.010000, \
>> np_load_long=1.000000
>> processors            4
>> user_lists            NONE
>> xuser_lists           NONE
>> projects              NONE
>> xprojects             NONE
>> usage_scaling         NONE
>> report_variables      NONE
>>
>> What I want to achieve is restrict jobs that do not specifically
>> request
>> memory requirements to 1GB of memory usage, so that extra memory is
>> available for jobs requiring more than 1GB, provided the extra
>> memory is
>> requested. However, the above setup does not seem to kill jobs that
>> use
>> more than 1GB without explicitly requesting it. Is there a way to
>> do this
>> without adding the virtual_free attribute to the queue definitions
>> (i.e. I
>> would prefer to keep this host based rather than defining separate
>> queues
>> for small and large memory jobs)?
>
> correct. virtual_free is only a not-enforced guidance for SGE for its
> scheduling decisions. If you want to have this limit enforced, then
> you just have to use h_vmem instead of virtual_free.
>
> -- Reuti
>
>
>>
>> Thanks,
>> Bart
>>
>> ------------------------------------------------------
>> http://gridengine.sunsource.net/ds/viewMessage.do?
>> dsForumId=38&dsMessageId=110060
>>
>> To unsubscribe from this discussion, e-mail: [users-
>> unsubscribe at gridengine.sunsource.net].
>>
>
> ------------------------------------------------------
> http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=38&dsMessageId=110458
>
> To unsubscribe from this discussion, e-mail:
> [users-unsubscribe at gridengine.sunsource.net].
>

------------------------------------------------------
http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=38&dsMessageId=110661

To unsubscribe from this discussion, e-mail: [users-unsubscribe at gridengine.sunsource.net].



More information about the gridengine-users mailing list