[GE users] virtual_free as consumable resource

bwillems b-willems at northwestern.edu
Thu Feb 19 22:04:03 GMT 2009


Hi All,

I am trying to set up limits on memory usage by SGE jobs following the
guidelines at

http://wikis.sun.com/display/GridEngine/Configuring+Complex+Resource+Attributes

So I have defined virtual_free as a consumable complex attribute with a
default value of 1G:

[root at fugu ~]# qconf -sc
...
virtual_free        vf         MEMORY      <=    YES         YES        1G
      0
...

I also set virtual_free equal to the total available physics memory on
each node, e.g.

[root at fugu ~]# qconf -se compute-0-20.local
hostname              compute-0-20.local
load_scaling          NONE
complex_values        slots=4,virtual_free=8G
load_values           arch=lx24-amd64,num_proc=4,mem_total=7990.878906M, \
                      swap_total=996.207031M,virtual_total=8987.085938M, \
load_avg=4.040000,load_short=4.010000, \
                      load_medium=4.040000,load_long=4.000000, \
                      mem_free=5591.191406M,swap_free=996.117188M, \
virtual_free=6587.308594M,mem_used=2399.687500M, \
swap_used=0.089844M,virtual_used=2399.777344M, \
cpu=100.000000,np_load_avg=1.010000, \
                      np_load_short=1.002500,np_load_medium=1.010000, \
np_load_long=1.000000
processors            4
user_lists            NONE
xuser_lists           NONE
projects              NONE
xprojects             NONE
usage_scaling         NONE
report_variables      NONE

What I want to achieve is restrict jobs that do not specifically request
memory requirements to 1GB of memory usage, so that extra memory is
available for jobs requiring more than 1GB, provided the extra memory is
requested. However, the above setup does not seem to kill jobs that use
more than 1GB without explicitly requesting it. Is there a way to do this
without adding the virtual_free attribute to the queue definitions (i.e. I
would prefer to keep this host based rather than defining separate queues
for small and large memory jobs)?

Thanks,
Bart

------------------------------------------------------
http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=38&dsMessageId=110060

To unsubscribe from this discussion, e-mail: [users-unsubscribe at gridengine.sunsource.net].



More information about the gridengine-users mailing list