[GE users] binary re-location

ron ron_chen_123 at yahoo.com
Wed Apr 28 01:25:36 BST 2010

    [ The following text is in the "utf-8" character set. ]
    [ Your display is set for the "ISO-8859-10" character set.  ]
    [ Some characters may be displayed incorrectly. ]

Are the spool directories of the exec hosts on NFS as well??

If not, then simply stopping and restarting the qmaster won't affect the jobs.


--- On Wed, 4/28/10, gg3796 <gg3796 at yahoo.com> wrote:
I believe I need to re-start execd on all nodes or reboot the cluster - (This will be the worst part)
I can not afford killing running or pending jobs at this point.

From: stephendennis <sdennis at univaud.com>
To: users at gridengine.sunsource.net
Sent: Tue, April 27, 2010 6:23:41 AM
Subject: RE: [GE users] binary re-location

Hello List

Possibly this solution will work for you.  I have written it in
commands to provide precision.

Assumes SGE_ROOT is /opt/sge and SGE_CELL is default, and
that SGE the above are located on filer:/export/opt/sge/default

    cd /opt
    mkdir sge.local
    rsync -ruvalP --exclude default sge/ sge.local/    #< copy
    qconf -km                #< kills the master
    umount /opt/sge      #< maybe will have to kill local
 execd, dbwriter, other stuff before this
    mv sge sge.save      #< move the old mountpoint out of the say (should be empty anyway)
    mv sge.local sge      #< move the new 
    rm -rf sge/default    #< remove the local copy of the spool, should be not there but just to be sure
    mount filer:/export/opt/sge/default /opt/sge/default  # < mount just the cell
    /etc/init.d/sgeqmaster start  # < start SGE

Surely there are some other details for your setup, but thats the gist of it.

From: rayson [rayrayson at gmail.com]
Sent: Tuesday, April 27, 2010 12:02 AM
To: users at gridengine.sunsource.net
Subject: Re: [GE users] binary re-location

First thing -- you will need to shutdown the qmaster during the
directory path migration, but doing so will not affect the running and
pending jobs.

Secondly, will you adjust the mount points so that the path names are
the same before and after the transition?? Otherwise, you will need to
adjust the bootstrap file:


Finally, you will need to adjust the "settings.[c]sh" scripts and/or
startup scripts.

As long as you don't delete or damage the spool directory, then your
jobs won't be lost -- which means "at most" you will cost extra

And I always suggest this quick and dirty hack -- if you move the
spool directory, you can create
 a symbolic link from the original
directory to the new one, and to SGE the path/location stays the same
after the migration.


P.S. I might miss a thing or 2, so test it with your test cluster
first if you can't affort an extra minute of downtime!

On 4/26/10, gg3796 <gg3796 at yahoo.com> wrote:
> Thanks Rayson
> sge binaries including qmaster spool directory are nfs mounted on qmaster
> and I want to place them on local drive on qmaster.
> thanks,
> Syed
> ________________________________
> From: rayson <rayrayson at gmail.com>
> To: users at gridengine.sunsource.net
> Sent: Mon,
 April 26, 2010 4:47:27 PM
> Subject: Re: [GE users] binary re-location
> Sorry, I am not following exactly...
> 1) SGE binaries or application binaries?
> 2) So currently, binaries are on an NFS mounted directory, and you
> want to place them on a local drive?
> Rayson
> On Mon, Apr 26, 2010 at 7:08 PM, gg3796 <gg3796 at yahoo.com> wrote:
> > Hi:
> > I am running 6.2u3 with binaries are nfs mounted on qmaster. I want to
> move
> > binaries local to qmaster. Is there a good way to do so without killing
> > running /pending jobs?
> >
> > thanks
> > SB
> >
> >
> ------------------------------------------------------
> To unsubscribe from this discussion, e-mail:
> [users-unsubscribe at gridengine.sunsource.net].


To unsubscribe from this discussion, e-mail: [users-unsubscribe at gridengine.sunsource.net].


Notice from Univa UD Postmaster:

This email message is for the sole use of the intended recipient(s) and may contain confidential and privileged
 information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. This message has been content scanned by the Univa UD Tumbleweed MailGate.



To unsubscribe from this discussion, e-mail: [users-unsubscribe at gridengine.sunsource.net].


To unsubscribe from this discussion, e-mail: [users-unsubscribe at gridengine.sunsource.net].

More information about the gridengine-users mailing list