[GE users] dynamic execution nodes recognition

Reuti reuti at staff.uni-marburg.de
Wed May 17 12:41:48 BST 2006


Hi,

what do you want to achieve in detail - maybe I didn't got the  
problem? I mean, you could define some hundred nodes in advance in  
SGE, and as long as they are not available they will not be honored  
by SGE for scheduling. If they appear, they will be used.

-- Reuti


Am 17.05.2006 um 13:23 schrieb Krzysztof Wilk:

> Hi all,
>
> I am struggling with the problem of dynamic recognition of  
> execution nodes.
>
> Master nodes has permanent IP address that is known to all execution
> nodes. Execution nodes have IP addresses from a known pool of  
> addresses.
> The naive approach of master polling execution nodes will not scale
> hence IMO the execution nodes should inform the master of their
> availability. I assume that both master host and each execution  
> node is
> a submit host as well.
>
> I came up with two methods how the nodes could contact the master:  
> DRMAA
> file staging (sending empty files) or sending ping (qping).
> I tend to the DRMAA approach because I think it is more reliable.
> Am I right?
>
> There is another problem arising: how the master should check for
> "signals" received by the nodes?
> I am thinking of two methods: load sensor or job prolog/epilog.
> I think the former is safer because if there were no jobs running  
> for a
> long time, no new available execution nodes would be found.
> Am I right?
>
> Maybe there is a more straightforward solution to dynamic execution
> nodes recognition.
>
> Thanks in advance for any hints or clues,
>
>
> Best,
> Chris
> -- 
> Chris Wilk                            chris.wilk at gridwisetech.com
> Consultant
>
> GridwiseTech                          office/fax: +48 12 294 71 20
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe at gridengine.sunsource.net
> For additional commands, e-mail: users-help at gridengine.sunsource.net

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe at gridengine.sunsource.net
For additional commands, e-mail: users-help at gridengine.sunsource.net




More information about the gridengine-users mailing list