[GE users] multiple clusters

Andreas Haas Andreas.Haas at Sun.COM
Thu May 6 14:36:07 BST 2004


I've seen recently that "job streaming" as shortly
circumscribed with the 6.0 bug report

   http://gridengine.sunsource.net/issues/show_bug.cgi?id=1013

is beneficial for performance b/c it facilitates keeping the
absolute number below a certain limit.

Job streaming was introduced with 5.3. To use it you would have
to wrap qsub command correspondingly. Can't say however whether
this would be applicable in your case or not.

Andreas

On Wed, 5 May 2004, Yogesh Chaudhary wrote:

>
> Hi All,
>
> We are trying to use two different clusters run by two qmasters
> separately, as the number of CPU's are increasing for our group(
> may be 1000)... I was wondering what may be the best way to do it.
>
> Will it help to have two separate SGE installs ? But we surely want
> to share the machines on these 2 clusters...Is there any other better
> way than using transfer-queues and globus in newer versions...
> sge5.5p6
> Or are these the only way of doing it right now...
>
> Please suggest me if you have already done this and is working fine
> for you..
>
> Users are worried about the scalability of gridengine, so I would like
> to do everything possible to make this work...
>
> One of the reason we want 2 clusters is, sometimes the qmaster is
> highly loaded..and the whole queue is hosed.. it happens when a user
> submits 1000's of simulations with 10 or more scripts runing at the
> same time on same or different machine.. Has anyone seen this or may
> be suggest a solution...
>
>
> thanks in advance, Yogesh
>
>
>
>
> --------------------------------------------------------------------------
> Yogesh Chaudhary
> Advanced Micro Devices,Inc ( PCS )
> 9500 Arboretum Blvd., Suite 400                       Phone:  512.602.5422
> Austin, TX 78759                                       Fax: 512.602.5051
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe at gridengine.sunsource.net
> For additional commands, e-mail: users-help at gridengine.sunsource.net
>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe at gridengine.sunsource.net
For additional commands, e-mail: users-help at gridengine.sunsource.net




More information about the gridengine-users mailing list