[GE users] resource management (resending to the list)

Ara.T.Howard Ara.T.Howard at noaa.gov
Mon Apr 26 16:49:47 BST 2004

On Mon, 26 Apr 2004, Chris Dagdigian wrote:

> > my delima is that if i simply added 50 or so more lines of code to the
> > above logic i could simply spawn the commands via ssh and not use sge at
> > all...  which is what i am currently doing.  my hope was to leverage the
> > volume of code sge contains, but it seems that the lever is a bit short
> > with the current version of sge...
> Many people building appliance type compute farms that are dedicated to 
> a single user, task or workflow find early on that the 'roll your own' 
> approach is easier, faster or better fitted to their needs than a more 
> general distributed resource management system like grid engine etc.
> The value of grid engine and similar systems is seen later on when:
>   o the original developer of the homegrown system leaves
>   o the existing system needs to be extended in functionality or size
>   or most often:
>   o The cluster/farm makes the switch from a single user or single 
> workflow to having to support multiple groups, users and projects.
> The added complexity, operational and management overhead that a more 
> general purpose DRM system becomes easily justified when the workflow 
> needs to take an unexpected direction or new user groups pop up 
> seemingly from nowhere :)
> It is not an either/or decision usually. The 'homegrown' or specialized 
> task farming systems can coexist with Grid Engine serving up resources 
> to the rest of the users/jobs.
> My $.02
> -Chris

thanks for the input... i'm weighing these ideas carefully right now for my

| EMAIL   :: Ara [dot] T [dot] Howard [at] noaa [dot] gov
| PHONE   :: 303.497.6469
| ADDRESS :: E/GC2 325 Broadway, Boulder, CO 80305-3328
| URL     :: http://www.ngdc.noaa.gov/stp/
| TRY     :: for l in ruby perl;do $l -e "print \"\x3a\x2d\x29\x0a\"";done 

To unsubscribe, e-mail: users-unsubscribe at gridengine.sunsource.net
For additional commands, e-mail: users-help at gridengine.sunsource.net

More information about the gridengine-users mailing list