[GE users] Accounting on Grid Engine 5.3/6.0

John Saalwaechter bababooey182 at yahoo.com
Fri May 21 19:05:28 BST 2004

I don't have this as a tool to offer, but I've gotten this
type of information by importing the GE accounting file into
a single SQL table.  Then one can do all types of queries for
aggregated or grouped information.  A MySQL table structure
is included below.

The main problem I encountered is that the fields in the GE
accounting file are colon-separated, but sometimes the data
itself contains colons.  For example, the qsub option
"-l h_cpu=2:0:0" ends up recorded in the accounting file, but
it interferes with the field separation.  At this point I've
used some custom perl to fix individual records.  In
general it's a hard problem to distinguish whether a particular
colon is field data or a field separator.

  qname varchar(50) default NULL,
  hostname varchar(50) default NULL,
  groupname varchar(20) default NULL,
  owner varchar(20) default NULL,
  job_name varchar(50) default NULL,
  job_number int(11) default NULL,
  account varchar(20) default NULL,
  priority int(10) unsigned default NULL,
  submission_time int(10) unsigned default NULL,
  start_time int(10) unsigned default NULL,
  end_time int(10) unsigned default NULL,
  failed int(11) default NULL,
  exit_status int(11) default NULL,
  ru_wallclock double default NULL,
  ru_utime double default NULL,
  ru_stime double default NULL,
  ru_maxrss double default NULL,
  ru_ixrss double default NULL,
  ru_ismrss double default NULL,
  ru_idrss double default NULL,
  ru_isrss double default NULL,
  ru_minflt double default NULL,
  ru_majflt double default NULL,
  ru_nswap double default NULL,
  ru_inblock double default NULL,
  ru_oublock double default NULL,
  ru_msgsnd double default NULL,
  ru_msgrcv double default NULL,
  ru_nsignals double default NULL,
  ru_nvcsw double default NULL,
  ru_nivcsw double default NULL,
  project varchar(50) default NULL,
  department varchar(50) default NULL,
  granted_pe varchar(50) default NULL,
  slots int(10) unsigned default NULL,
  task_number int(10) unsigned default NULL,
  cpu double default NULL,
  mem double default NULL,
  io double default NULL,
  category varchar(50) default NULL,
  iow double default NULL,
  pe_taskid varchar(50) default NULL,
  maxvmem double default NULL,
  KEY owner (owner),
  KEY owner_2 (owner)

--- Ron Chen <ron_chen_123 at yahoo.com> wrote:
> See if this one is OK or not:
> http://gridengine.sunsource.net/servlets/ReadMsg?msgId=10104&listName=users
> It extracts the information from the accounting files
> and draws chats (see the samples at the bottom of the
> page).
>  -Ron
> --- Damir Danijel Zagar <dzagar at srce.hr> wrote:
> > I'm looking for simple accounting tool for Grid
> > Engine to get statistics
> > per user/period on number of jobs done, average CPU
> > time spent for the
> > yob, time spent in the queue... qacct provides some
> > information - but
> > not enough.
> > 
> > Damir Zagar
> > Cluster & Grid Dept.
> > University Computing Centre
> > Zagreb, Croatia
> >  
> > 

John Saalwaechter <bababooey182 at yahoo.com>

Do you Yahoo!?
Yahoo! Domains ? Claim yours for only $14.70/year

To unsubscribe, e-mail: users-unsubscribe at gridengine.sunsource.net
For additional commands, e-mail: users-help at gridengine.sunsource.net

More information about the gridengine-users mailing list