[GE users] virtual_free as consumable resource

reuti reuti at staff.uni-marburg.de
Fri Feb 20 10:09:41 GMT 2009


Hi,

Am 19.02.2009 um 23:04 schrieb bwillems:

> I am trying to set up limits on memory usage by SGE jobs following the
> guidelines at
>
> http://wikis.sun.com/display/GridEngine/Configuring+Complex+Resource 
> +Attributes
>
> So I have defined virtual_free as a consumable complex attribute  
> with a
> default value of 1G:
>
> [root at fugu ~]# qconf -sc
> ...
> virtual_free        vf         MEMORY      <=    YES          
> YES        1G
>       0
> ...
>
> I also set virtual_free equal to the total available physics memory on
> each node, e.g.
>
> [root at fugu ~]# qconf -se compute-0-20.local
> hostname              compute-0-20.local
> load_scaling          NONE
> complex_values        slots=4,virtual_free=8G
> load_values           arch=lx24- 
> amd64,num_proc=4,mem_total=7990.878906M, \
>                        
> swap_total=996.207031M,virtual_total=8987.085938M, \
> load_avg=4.040000,load_short=4.010000, \
>                       load_medium=4.040000,load_long=4.000000, \
>                       mem_free=5591.191406M,swap_free=996.117188M, \
> virtual_free=6587.308594M,mem_used=2399.687500M, \
> swap_used=0.089844M,virtual_used=2399.777344M, \
> cpu=100.000000,np_load_avg=1.010000, \
>                        
> np_load_short=1.002500,np_load_medium=1.010000, \
> np_load_long=1.000000
> processors            4
> user_lists            NONE
> xuser_lists           NONE
> projects              NONE
> xprojects             NONE
> usage_scaling         NONE
> report_variables      NONE
>
> What I want to achieve is restrict jobs that do not specifically  
> request
> memory requirements to 1GB of memory usage, so that extra memory is
> available for jobs requiring more than 1GB, provided the extra  
> memory is
> requested. However, the above setup does not seem to kill jobs that  
> use
> more than 1GB without explicitly requesting it. Is there a way to  
> do this
> without adding the virtual_free attribute to the queue definitions  
> (i.e. I
> would prefer to keep this host based rather than defining separate  
> queues
> for small and large memory jobs)?

correct. virtual_free is only a not-enforced guidance for SGE for its  
scheduling decisions. If you want to have this limit enforced, then  
you just have to use h_vmem instead of virtual_free.

-- Reuti


>
> Thanks,
> Bart
>
> ------------------------------------------------------
> http://gridengine.sunsource.net/ds/viewMessage.do? 
> dsForumId=38&dsMessageId=110060
>
> To unsubscribe from this discussion, e-mail: [users- 
> unsubscribe at gridengine.sunsource.net].
>

------------------------------------------------------
http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=38&dsMessageId=110458

To unsubscribe from this discussion, e-mail: [users-unsubscribe at gridengine.sunsource.net].



More information about the gridengine-users mailing list