[GE users] Cleaning scratch files.

Craig Tierney ctierney at hypermall.net
Thu Jun 29 00:02:47 BST 2006


    [ The following text is in the "ISO-8859-1" character set. ]
    [ Your display is set for the "ISO-8859-10" character set.  ]
    [ Some special characters may be displayed incorrectly. ]

Rayson Ho wrote:
> AFAIK, the prolog & epilog are only run on the first node, even for
> tight PE integration...
> 

You are correct.  Use your favorite distributed shell command (pdsh for 
instance) to run the rm command on all of the nodes simultaneously based
on the provided host list.

This is how our large clusters have been running for over 4 years.

Craig


> Rayson
> 
> 
> 
> 
> On 6/28/06, Craig Tierney <ctierney at hypermall.net> wrote:
>> Baudilio Tejerina wrote:
>> > Hi,
>> >
>> > If in a parallel job, where several scratch files are created in the
>> > respective local-node disks, the job is deleted (qdel), the scratch
>> > files remain there. Is there any way to have 'sge' taking care of them
>> > (automatically removed them)?
>> >
>> > I've tried by inserting the appropriate 'rm' statement in the executing
>> > script but, these only work if the jobs successfully finish, obviously.
>> >
>>
>> Add the rm statement in the job prologue.  That is guaranteed to run
>> before every job, and and clean up the tmp space if there are stale 
>> files.
>>
>> Craig
>>
>>
>> > Thanks for any help anyone might bring.
>> >
>> > Regards.
>> >
>> > Baudilio
>> >
>> > ---------------------------------------------------------------------
>> > To unsubscribe, e-mail: users-unsubscribe at gridengine.sunsource.net
>> > For additional commands, e-mail: users-help at gridengine.sunsource.net
>> >
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: users-unsubscribe at gridengine.sunsource.net
>> For additional commands, e-mail: users-help at gridengine.sunsource.net
>>
>>
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe at gridengine.sunsource.net
> For additional commands, e-mail: users-help at gridengine.sunsource.net
> 

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe at gridengine.sunsource.net
For additional commands, e-mail: users-help at gridengine.sunsource.net




More information about the gridengine-users mailing list