[GE users] Helpers and Performance

Laurence Moughan Laurence.Moughan at aerlingus.com
Thu Apr 3 12:03:10 BST 2008

Hi All,
Does anyone have any guidlines as to number of helpers an SGE job should use. I have been advised by a vendor to set max to 4 helpers due to 
"When dividing a job in to several parallel jobs, a master job is created to handle the communication between the parallel helper jobs. When you get too much overhead communication, at some point this "eats up" the performance gain."
We have 20 cpus in the sge cluster, so why shouldn't i have 19 helpers to my 1 main job ?

..For low fares and great deals on hotels, car hire and travel insurance visit http://www.aerlingus.com
This email and any files transmitted with it are confidential and
intended solely for the use of the individual or entity to whom they
are addressed.  Any review, dissemination or other use of, or taking
of any action in reliance upon, this information by persons or entities
other than the intended recipient is prohibited.If you have received
this email in error please notify the sender immediately and delete
the material. 
Aer Lingus Limited
Registered in Ireland
Company Number 9215
Registered Office at Dublin Airport, Dublin,Ireland.

More information about the gridengine-users mailing list