[GE users] Load sensors and scheduling cycle

[Olesen, Mark]

Hi Beat,

> I'm working on a project where transfer queues could save me a lot of
> headache. One open point I see is the load sensor which reports back
> the
> amount of free slots in the destination cluster.
> 
> Is there any way to make sure the load sensor is polled before and
> each time
> the scheduler starts it's scheduling cycle?

I don't think that this approach will do what you want. The problem is
(again) analogous to using load sensors and external licence management.
Even apart from the overhead of calling a load sensor for XX hosts
before each scheduler run and decay problems, you seriously risk
dispatching too many jobs at a particular scheduling interval.

To test this configuration, you could have a very small report interval
(eg, 5 sec) and a very long scheduling interval (eg, 60 sec).

For testing, you could stuff the cluster with lots of jobs awaiting a
free transfer queue. As soon as a slot becomes available (as reported by
the load sensor), all the jobs will be dispatched ... even if there is
only room for 1 job.

If you (mis)use a load sensor to adjust a consumable complex and then
catch any problems with a starter script you might get it to work
though.

/mark
This e-mail message and any attachments may contain 
legally privileged, confidential or proprietary Information, 
or information otherwise protected by law of EMCON 
Technologies, its affiliates, or third parties. This notice 
serves as marking of its ?Confidential? status as defined 
in any confidentiality agreements concerning the sender 
and recipient. If you are not the intended recipient(s), 
or the employee or agent responsible for delivery of this 
message to the intended recipient(s), you are hereby 
notified that any dissemination, distribution or copying 
of this e-mail message is strictly prohibited. 
If you have received this message in error, please 
immediately notify the sender and delete this e-mail 
message from your computer.


---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe at gridengine.sunsource.net
For additional commands, e-mail: users-help at gridengine.sunsource.net