[GE users] File staging problem

Gerhard Venter gventer at sun.ac.za
Tue Jul 8 08:32:49 BST 2008

I am using SGE 6.0 and OpenMPI.  I am distributing my job to multiple
slots using a round robin mpi parallel environment - the result is that
each slot is on a different compute node, each with its own local disk
storage.  I would like to stage files from my home directory to the
TMPDIR on each compute node that MPI will use.  My submit script looks
something like this:

#$ -cwd
#$ -j y
#$ -pe openmpi_rr 4
cp input.dat $TMPDIR
mpirun -np ${NSLOTS} $SGE_O_WORKDIR/mpijob

The cd $TMPDIR does change the pwd on each node to $TMPDIR (I print the
value for all slots from my mpi program), however, the files are only
copied to the first MPI slot (the master slot) and not the other slots
(the worker slots).  I have also implemented the prolog and epilog
scripts from


but with the same result.  

Am I missing something?  Is there a way that I can stage input files for
all the slots that will be used in a MPI job?


|| Prof. Gerhard Venter
|| Departement Meganiese en        |  Department of Mechanical and
||   Megatroniese Ingenieurswese   |    Mechatronic Engineering
|| Universiteit Stellenbosch       |  Stellenbosch  University
|| Privaat Sak X1 Matieland 7602   |  Private Bag X1 Matieland 7602  
|| Suid-Afrika                     |  South Africa
|| Tel: +27 21 808 3560
|| E-Mail: gventer at sun.ac.za          Web: www.eng.sun.ac.za

To unsubscribe, e-mail: users-unsubscribe at gridengine.sunsource.net
For additional commands, e-mail: users-help at gridengine.sunsource.net

More information about the gridengine-users mailing list