[GE users] question about job queue interval
Dan.Gruhn at Group-W-Inc.com
Thu Apr 21 19:42:48 BST 2005
[ The following text is in the "iso-8859-13" character set. ]
[ Your display is set for the "ISO-8859-10" character set. ]
[ Some special characters may be displayed incorrectly. ]
I'm using 6.0u3, but hopefully it is the same. You can change the
scheduler time period with the qconf command:
will show you your current configuration and
will allow you to set schedule_interval to say 5 or 10 seconds. Used
to see what the command does or look at the manual page.
On Thu, 2005-04-21 at 14:32, Chris Duke wrote:
> I have a question about the job queue interval. I apologize in advance
> if the terms I use are not exactly correct, I?m fairly new to this.
> I?m using SGE 5.3p6. We use SGE for a regression test. We run about
> 2000 small jobs in a full regression test. The average test is about
> 10-20 seconds (wall clock).
> What I?ve noticed is that the queuing process on the master seems to
> run about every 15 seconds. What this occasionally causes is long gaps
> when all the queues are empty, and they don?t get populated with new
> jobs for several seconds. This delay is not a huge problem, but when
> you calculate the ratio of the delay to the execution time of the job,
> it is rather large. By reducing that delay, I am hoping to finish the
> regression test run much more quickly I realize that there would be
> additional overhead associated with shorter intervals (because of
> increased polling), but I would like to be able to experiment and
> Solutions that seem like they would work, but I don?t know how to
> manipulate the system to do:
> * Control the poll interval of the master and all execute hosts.
> Reduce and optimize.
> * Our typical execute host has 2 CPU?s. Control the master so
> that it might put 3 jobs into a particular execute hosts
> queue, but the execute host would only be allowed to execute 2
> jobs at a time. That way the execute host always has something
> to do, instead of periods of idle time.
> Thanks in advance for any help and ideas.
More information about the gridengine-users