[GE users] Parallel 'make'

David Olbersen dolbersen at nextwave.com
Mon Jun 2 21:50:20 BST 2008


Reuti,

No firewalls, no other parallel integration at all.
Most of our jobs are numerous runs of single-threaded applications, with
different input for each run.
Now one of my users has asked if they can run "make" on the cluster to
get some speed benefit.
This is to be the first parallel application.

-- 
David Olbersen
 

-----Original Message-----
From: Reuti [mailto:reuti at staff.uni-marburg.de] 
Sent: Monday, June 02, 2008 1:30 PM
To: users at gridengine.sunsource.net
Subject: Re: [GE users] Parallel 'make'

Hi,

Am 02.06.2008 um 19:34 schrieb David Olbersen:

> I must be missing something, but I thought it would be pretty 
> straightforward to run `make` via `qmake` to get some parallel 
> advantage. It looks like this was a bad assumption. All the 
> documentation I could find mentions using LAM, MPI, or some other 
> extra application: is that really required to get "make" running on a 
> few machines in my cluster?
>
> Here's what I've tried so far:
>
> % qmake -cwd -V -pe test1 1-8 -q rfic -l arch=lx24-x86 -- 
> PLATFORM=nw2000e
> qmake: *** Warning: File `builds/nw2000e-debug-opt-rvct-3.0b617-
> threadx42/depends.mak' has modification time in the future
> (2008-06-02 10:20:40 > 2008-06-02 10:20:30) 
> sge-alfrodull-069.eng.atg.nw.net
> error: executing task of job 435644 failed:
> qmake: *** remote_status: No child processes.  Stop.
> qmake: *** Waiting for unfinished jobs....
> qmake: *** remote_status: No child processes.  Stop.
>
> ... which exits very quickly and doesn't really do any builds.
>
> % qmake -cwd -V -q rfic -l arch=lx24-x86 -- PLATFORM=nw2000e
> qmake: *** Warning: File `builds/nw2000e-debug-opt-rvct-3.0b617-
> threadx42/depends.mak' has modification time in the future
> (2008-06-02 10:16:40 > 2008-06-02 10:16:30) dynamic mode Build info: 
> nw2000e-debug-opt-rvct-3.0b617-threadx42 Mon Jun 2 10:16:30 PDT 2008 
> dolbersen at sge-alfrodull-071 dynamic mode dynamic mode dynamic mode 
> dynamic mode dynamic mode dynamic mode dynamic mode dynamic mode 
> dynamic mode dynamic mode dynamic mode dynamic mode
> error: error waiting on socket for client to connect: Interrupted 
> system call

other parallel apps are running using a Tight Integration? Any firewall?
- Reuti

>
> ... which does each job one at a time, as though I'd just run  
> "make" -- no advantage at all.
>
> Can anybody help? Pointing me to documentation should be more than  
> enough -- I've not been able to find what I'm looking for.
>
> David Olbersen
>
>


---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe at gridengine.sunsource.net
For additional commands, e-mail: users-help at gridengine.sunsource.net



---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe at gridengine.sunsource.net
For additional commands, e-mail: users-help at gridengine.sunsource.net




More information about the gridengine-users mailing list