[GE users] Array Task Interleave
Dan.Gruhn at groupw.com
Fri Apr 16 21:22:05 BST 2010
[ The following text is in the "iso-8859-1" character set. ]
[ Your display is set for the "ISO-8859-10" character set. ]
[ Some special characters may be displayed incorrectly. ]
I have a job setup where an array of tasks is used to create individual sets of data that another array of tasks (the same number in both cases) then load into a database.
I have started using the -hold_jid_ad to have the second stage tasks wait until their corresponding first stage tasks are finished. What I would like to have happen is that when a first stage task is finished, the corresponding second stage task becomes ready and will run before the other first stage task starts running.
I have done this by lowering the priority of the first stage tasks, but that means that other jobs in the grid will run before my first stage tasks. I would like to raise the priority of the second stage tasks, but only an administrator or manager can do this, and these jobs are run by regular users.
Does anyone have any ideas how I might accomplish this without putting my first stage tasks at a lower priority?
More information about the gridengine-users