[GE users] Resource usage for OpenMP jobs

Rayson Ho rayrayson at gmail.com
Sat Mar 11 01:44:23 GMT 2006


    [ The following text is in the "ISO-8859-1" character set. ]
    [ Your display is set for the "ISO-8859-10" character set.  ]
    [ Some special characters may be displayed incorrectly. ]

Jean-paul,

Can you run qacct on a finished job too??

While the execd cannot track the slave threads due to the /proc layout
change in 2.6 kernels that Ron mentioned, I remember at job end the
execd calls getrusage(2) to collect the resource usage from the OS.

If this is done correctly, then at least fair share usage is working
as expected... only that you won't see the CPU time used by the slave
threads until the end.

Rayson



On 3/10/06, Ron Chen <ron_chen_123 at yahoo.com> wrote:
> The /proc layout changed in 2.6 Linux kernels and looks like we
> need to fix something - should be a small fix :)
>
> Actually, it was discussed before:
> http://gridengine.sunsource.net/servlets/BrowseList?list=dev&by=thread&from=2531
>
> Please open an issue and assign it to user "ron".
>
>  -Ron
>
>
> --- Jean-Paul Minet <minet at cism.ucl.ac.be> wrote:
> > Rayson Ho wrote:
> > > What OS?? Also, is the resource usage of your OpenMP jobs
> > reported
> > > correctly by qacct??
> >
> > linux kernel 2.6.5 (SLES 9)
> >
> > Current smp job is not finished.  Qstat gives:
> >
> >     6199 0.00081 DNA3       vanlier      r     03/10/2006
> > 01:52:56
> > all.q at lmexec-6                     4
> >
> > qstat -j 6199 shows:
> >
> > ...
> > parallel environment:  smp range: 4
> > usage    1:                 cpu=15:31:19, mem=311238.75355
> > GBs, io=0.00000,
> > vmem=5.587G, maxvmem=5.596G
> > ...
> >
> > It seems usage reported is for master thread only (job started
> > 15h30' ago).
> >
> > Jean-paul
> >
> > > Rayson
> > >
> > >
> > >
> > > On 3/10/06, Jean-Paul Minet <minet at cism.ucl.ac.be> wrote:
> > >
> > >>Hi,
> > >>
> > >>I was wondering how, for fair share usage calculations, make
> > SGE to take into
> > >>account resources effectively used by OpenMP jobs (in terms
> > of cpu usage).
> > >>
> > >>Any idea?
> > >>
> > >>Thanks
> > >>--
> > >>Jean-Paul Minet
> > >>Gestionnaire CISM - Institut de Calcul Intensif et de
> > Stockage de Masse
> > >>Université Catholique de Louvain
> > >>Tel: (32) (0)10.47.35.67 - Fax: (32) (0)10.47.34.52
> > >>
> >
> >>---------------------------------------------------------------------
> > >>To unsubscribe, e-mail:
> > users-unsubscribe at gridengine.sunsource.net
> > >>For additional commands, e-mail:
> > users-help at gridengine.sunsource.net
> > >>
> > >>
> > >
> > >
> > >
> >
> ---------------------------------------------------------------------
> > > To unsubscribe, e-mail:
> > users-unsubscribe at gridengine.sunsource.net
> > > For additional commands, e-mail:
> > users-help at gridengine.sunsource.net
> > >
> > >
> > >
> > >
> >
> > --
> > Jean-Paul Minet
> > Gestionnaire CISM - Institut de Calcul Intensif et de Stockage
> > de Masse
> > Université Catholique de Louvain
> > Tel: (32) (0)10.47.35.67 - Fax: (32) (0)10.47.34.52
> >
> >
> ---------------------------------------------------------------------
> > To unsubscribe, e-mail:
> > users-unsubscribe at gridengine.sunsource.net
> > For additional commands, e-mail:
> > users-help at gridengine.sunsource.net
> >
> >
>
>
> __________________________________________________
> Do You Yahoo!?
> Tired of spam?  Yahoo! Mail has the best spam protection around
> http://mail.yahoo.com
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe at gridengine.sunsource.net
> For additional commands, e-mail: users-help at gridengine.sunsource.net
>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe at gridengine.sunsource.net
For additional commands, e-mail: users-help at gridengine.sunsource.net




More information about the gridengine-users mailing list