[GE users] parallel job woes

pollinger harald.pollinger at sun.com
Thu Jul 2 11:14:17 BST 2009


Which architecture are you using?
Are you hitting IZ 2916 ("qrsh large memory consumption in IA64")?

Regards,
Harald

ah_sunsource wrote:
> Hi *,
> 
> we observe a problem with huge parallel jobs (>50 subtasks). Each
> parallel task requires round about 500MB h_vmem (h_vmem is configured as
> consumable host resource). So that's the actual memory requirement. But
> starting the subtasks via qrsh in the master process uses >50MB virtual
> memory for every connection. That's why the job gets killed.
> 
> Is there a way to specify a different memory requirement for the master
> task? Or maybe switch off memory enforcing for the master task as this
> is actually SGE internal mem consumption?
> 
> Thanks & Cheers,
> Andreas
> 


-- 
Sun Microsystems GmbH         Harald Pollinger
Dr.-Leo-Ritter-Str. 7         Sun Grid Engine Engineering
D-93049 Regensburg            Phone: +49 (0)941 3075-209  (x60209)
Germany                       Fax: +49 (0)941 3075-222  (x60222)
http://www.sun.com/gridware
mailto:harald.pollinger at sun.com
Sitz der Gesellschaft:
Sun Microsystems GmbH, Sonnenallee 1, D-85551 Kirchheim-Heimstetten
Amtsgericht Muenchen: HRB 161028
Geschaeftsfuehrer: Thomas Schroeder, Wolfgang Engels, Wolf Frenkel
Vorsitzender des Aufsichtsrates: Martin Haering

------------------------------------------------------
http://gridengine.sunsource.net/ds/viewMessage.do?dsForumId=38&dsMessageId=204908

To unsubscribe from this discussion, e-mail: [users-unsubscribe at gridengine.sunsource.net].



More information about the gridengine-users mailing list