[GE issues] [Issue 2510] poor qacct -j <jobid> performance

roland roland.dittel at sun.com
Thu May 7 15:40:42 BST 2009


User roland changed the following:

                What    |Old value                 |New value
                  Status|STARTED                   |RESOLVED
              Resolution|                          |FIXED
        Target milestone|---                       |6.2u3

------- Additional comments from roland at sunsource.net Thu May  7 07:40:33 -0700 2009 -------
qacct always parses the a complete accounting line, dups some strings (job_name, account_name ...) and then evaluates whether this line is
of interest.

The fix is:
1) Evaluate whether this line is of interest immediatly once a field (taken from strtok()) is ready. The time required to parse the
additional fields is then saved
2) Don't strdup() immediatly when a field is ready. Work on the local storage as long as possible and copy the strings only at the end when
the line is of interest

For a accounting file with 90000 entries this improved the qacct runtime by factor 7. For more entries the improvement will be higher.


To unsubscribe from this discussion, e-mail: [issues-unsubscribe at gridengine.sunsource.net].

More information about the gridengine-users mailing list