[GE users] SGE configuration for multi-core multi-processor nodes cluster

templedf dan.templeton at sun.com
Mon Jan 25 21:51:29 GMT 2010


The distribution of parallel tasks on nodes in managed by the 
allocation_rule in the parallel environment configuration.  As for 
getting fill-up behavior rather than spread the load out, just setting 
job_load_adjustments in the scheduling configuration to NONE should do it.


On 01/25/10 07:04, letigre wrote:
> Hi all,
> I am pretty new here so please forgive me if my question sounds too basic but ur help would anyway be much appreciated.
> I have been submitting parallel jobs to a new cluster which comprises 44 nodes, each made of 2 quadri-core processors, i.e. 8 processors per node. SGE configuration has been set up very basically on the cluster and in the current state, SGE always distributes a N processors job on N nodes (if N  is less than 44). This is not very efficient for large jobs and not very predictable in terms of distribution as soon as N>  44. What we are looking for is the following configuration:
> (a) serial and parallel jobs up to 7 processors are pile up on already partly occupied nodes if available.
> Example: assume that all nodes are available  except Node 1 on which 3 processors are used, if I submit a 4 processors job, I would like all processes to run on Node 1, in the current configuration I would have the following: process 1 on Node 2, process 2 on Node 3, process 3 on Node 4 and process 4 on Node 5
> (b) big jobs submitted on M processors, where M is a multiple of 8, are distributed on M/8 nodes, if available, which implies that my job occupies all processors of the nodes on which it runs.
> Option (a) would contribute to have nodes where all processors are available such that option (b) is feasible.
> Ultimately, it would be nice, somehow, to be able to set the number of processors used on each node by a job.
> Example: I submit a 32 processors job and I would like it to run on 8 nodes with 4 processors per node.
> Is there a way to configure the SGE set up to do that all or partly ? Is this a part of SGE set up and should I specify it as I submit  jobs with "qsub" ?
> I am pretty sure this might sound like basic configuration to many of you but any advice would be very helpful.
> Thanks in advance,
> Anthony
> ------------------------------------------------------
> http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=38&dsMessageId=240902
> To unsubscribe from this discussion, e-mail: [users-unsubscribe at gridengine.sunsource.net].


To unsubscribe from this discussion, e-mail: [users-unsubscribe at gridengine.sunsource.net].

More information about the gridengine-users mailing list