[GE users] SGE large memory jobs

adary adary at marvell.com
Wed Jul 15 13:29:48 BST 2009


You can also use the exclusive scheduling feature in 6.2u3 but complex for memory is still a very good idea.

The problems start when your users request less or more than they need

-----Original Message-----
From: Marco.Donauer at Sun.COM [mailto:Marco.Donauer at Sun.COM]
Sent: Wednesday, July 15, 2009 3:15 PM
To: users at gridengine.sunsource.net
Subject: Re: [GE users] SGE large memory jobs

Hi,
you have to set  the complex_values for each exechost.
In your case set complex_values to mem_free=5G (using qconf -me <exechost>)
Set the mem_free complex to consumable to yes (qconf -mc) and submit
your jobs like this:

qsub -l mem_free=5G java.sge


Now only one job per host will be scheduled. Setting complex_value to 8G
you will have 8G of mem available for consuming

Marco

On 07/12/09 04:43, mbay2002 wrote:
> A user is running a java based script that requires 5 GB of memory. Each of our nodes has 8 GB of RAM available.
>
> He is trying something along the lines of
>
> qsub -l mem_free=5G java.sge
> sleep 10
> qsub -l mem_free=5G java.sge
>
> However, even though we have plenty of open nodes, after submitting several jobs like this, a few end up on the same node, and the jobs start paging.
>
> We have a pretty vanilla install of SGE, we haven't done any special configuration.  I honestly do not know SGE well enough to know if there is a simple way to ensure that these jobs get assigned one per node.
>
> I've done a bit of RTFM'ing, but could use a hint at this point.
>
> This is SGE 6.2
>
> ------------------------------------------------------
> http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=38&dsMessageId=206604
>
> To unsubscribe from this discussion, e-mail: [users-unsubscribe at gridengine.sunsource.net].
>

--

Sun Microsystems GmbH         Marco Donauer
Dr.-Leo-Ritter-Str. 7         SUN Grid Engine Engineering
D-93049 Regensburg            Phone: +49 (0)941 3075-211  (x60211)
Germany                       Fax: +49 (0)941 3075-222  (x60222)
http://www.sun.com/gridware
mailto:marco.donauer at sun.com
Sitz der Gesellschaft: Sun Microsystems GmbH, Sonnenallee 1,
D-85551 Kirchheim-Heimstetten
Amtsgericht Muenchen: HRB 161028
Geschaeftsfuehrer: Thomas Schroeder, Wolfgang Engels, Dr. Roland Boemer
Vorsitzender des Aufsichtsrates: Martin Haering

------------------------------------------------------
http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=38&dsMessageId=207322

To unsubscribe from this discussion, e-mail: [users-unsubscribe at gridengine.sunsource.net].

------------------------------------------------------
http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=38&dsMessageId=207325

To unsubscribe from this discussion, e-mail: [users-unsubscribe at gridengine.sunsource.net].



More information about the gridengine-users mailing list