[GE users] Resource usage for OpenMP jobs

Jean-Paul Minet minet at cism.ucl.ac.be
Tue Mar 14 14:59:01 GMT 2006


    [ The following text is in the "ISO-8859-1" character set. ]
    [ Your display is set for the "ISO-8859-10" character set.  ]
    [ Some special characters may be displayed incorrectly. ]

Rayson,

> Can you run qacct on a finished job too??
> 
> While the execd cannot track the slave threads due to the /proc layout
> change in 2.6 kernels that Ron mentioned, I remember at job end the
> execd calls getrusage(2) to collect the resource usage from the OS.

you are right,  here is the output for one finished smp job:

qsub_time    Mon Mar  6 18:36:24 2006
start_time   Mon Mar  6 21:10:42 2006
end_time     Mon Mar 13 09:38:59 2006
granted_pe   smp
slots        2
failed       0
exit_status  0
ru_wallclock 563297
ru_utime     869097
ru_stime     63187

thanks for your input

Jean-Paul

> If this is done correctly, then at least fair share usage is working
> as expected... only that you won't see the CPU time used by the slave
> threads until the end.
> 
> Rayson
> 
> 
> 
> On 3/10/06, Ron Chen <ron_chen_123 at yahoo.com> wrote:
> 
>>The /proc layout changed in 2.6 Linux kernels and looks like we
>>need to fix something - should be a small fix :)
>>
>>Actually, it was discussed before:
>>http://gridengine.sunsource.net/servlets/BrowseList?list=dev&by=thread&from=2531
>>
>>Please open an issue and assign it to user "ron".
>>
>> -Ron
>>
>>
>>--- Jean-Paul Minet <minet at cism.ucl.ac.be> wrote:
>>
>>>Rayson Ho wrote:
>>>
>>>>What OS?? Also, is the resource usage of your OpenMP jobs
>>>
>>>reported
>>>
>>>>correctly by qacct??
>>>
>>>linux kernel 2.6.5 (SLES 9)
>>>
>>>Current smp job is not finished.  Qstat gives:
>>>
>>>    6199 0.00081 DNA3       vanlier      r     03/10/2006
>>>01:52:56
>>>all.q at lmexec-6                     4
>>>
>>>qstat -j 6199 shows:
>>>
>>>...
>>>parallel environment:  smp range: 4
>>>usage    1:                 cpu=15:31:19, mem=311238.75355
>>>GBs, io=0.00000,
>>>vmem=5.587G, maxvmem=5.596G
>>>...
>>>
>>>It seems usage reported is for master thread only (job started
>>>15h30' ago).
>>>
>>>Jean-paul
>>>
>>>
>>>>Rayson
>>>>
>>>>
>>>>
>>>>On 3/10/06, Jean-Paul Minet <minet at cism.ucl.ac.be> wrote:
>>>>
>>>>
>>>>>Hi,
>>>>>
>>>>>I was wondering how, for fair share usage calculations, make
>>>
>>>SGE to take into
>>>
>>>>>account resources effectively used by OpenMP jobs (in terms
>>>
>>>of cpu usage).
>>>
>>>>>Any idea?
>>>>>
>>>>>Thanks
>>>>>--
>>>>>Jean-Paul Minet
>>>>>Gestionnaire CISM - Institut de Calcul Intensif et de
>>>
>>>Stockage de Masse
>>>
>>>>>Université Catholique de Louvain
>>>>>Tel: (32) (0)10.47.35.67 - Fax: (32) (0)10.47.34.52
>>>>>
>>>
>>>>---------------------------------------------------------------------
>>>>
>>>>>To unsubscribe, e-mail:
>>>
>>>users-unsubscribe at gridengine.sunsource.net
>>>
>>>>>For additional commands, e-mail:
>>>
>>>users-help at gridengine.sunsource.net
>>>
>>>>>
>>>>
>>>>
>>---------------------------------------------------------------------
>>
>>>>To unsubscribe, e-mail:
>>>
>>>users-unsubscribe at gridengine.sunsource.net
>>>
>>>>For additional commands, e-mail:
>>>
>>>users-help at gridengine.sunsource.net
>>>
>>>>
>>>>
>>>>
>>>--
>>>Jean-Paul Minet
>>>Gestionnaire CISM - Institut de Calcul Intensif et de Stockage
>>>de Masse
>>>Université Catholique de Louvain
>>>Tel: (32) (0)10.47.35.67 - Fax: (32) (0)10.47.34.52
>>>
>>>
>>
>>---------------------------------------------------------------------
>>
>>>To unsubscribe, e-mail:
>>>users-unsubscribe at gridengine.sunsource.net
>>>For additional commands, e-mail:
>>>users-help at gridengine.sunsource.net
>>>
>>>
>>
>>
>>__________________________________________________
>>Do You Yahoo!?
>>Tired of spam?  Yahoo! Mail has the best spam protection around
>>http://mail.yahoo.com
>>
>>---------------------------------------------------------------------
>>To unsubscribe, e-mail: users-unsubscribe at gridengine.sunsource.net
>>For additional commands, e-mail: users-help at gridengine.sunsource.net
>>
>>
> 
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe at gridengine.sunsource.net
> For additional commands, e-mail: users-help at gridengine.sunsource.net
> 
> 
> 
> 

-- 
Jean-Paul Minet
Gestionnaire CISM - Institut de Calcul Intensif et de Stockage de Masse
Université Catholique de Louvain
Tel: (32) (0)10.47.35.67 - Fax: (32) (0)10.47.34.52

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe at gridengine.sunsource.net
For additional commands, e-mail: users-help at gridengine.sunsource.net




More information about the gridengine-users mailing list