[PATCH 0/7] sched_domain balancing via tasklet V3

This patchset moves potentially expensive load balancing out of the scheduler
tick (where we run with interrupts disabled) into a tasklet that is triggered
if necessary from scheduler_tick(). Load balancing will then run with interrupts
enabled. This eliminates interrupt holdoff times and avoids potential machine
livelock if f.e. load balancing is performed over a large number of processors
and many of the nodes experience heavy load which may lead to delays in
fetching cachelines. We have currently up to 1024 processors and may go up
to 4096 soon. Similar issues were seen on a Fujitsu system in the past.

However, this issue also highlights the general problem of interrupt
holdoff during scheduler load balancing.

The moving of the load balancing into a tasklet also allows some
cleanup in scheduler_tick(). It gets easier to read and the determination
of the state for load balancing can be moved out of scheduler_tick().

Further optimization of scheduler_tick() processing occurs because we
no longer check all the sched domains on each tick.
We determine the time of the next load balancing on every load balancing
and check against this single value in scheduler_tick().

Another optimization is that we perform the staggering of the individual
load balance operations not during load balancing but shift that
to the setup of the sched domains.

For the earlier discussion see:
http://marc.theaimsgroup.com/?t=116119187800002&r=1&w=2
V1: http://marc.theaimsgroup.com/?l=linux-kernel&m=116171494001548&w=2
V2: http://marc.theaimsgroup.com/?l=linux-kernel&m=116200355408187&w=2

V1-V2:
- Keep last_balance and calculate the next balancing from that start
point.
- Move more code into time_slice calculation and rename time_slice()
to task_running_tick().
- Separate out the wake_priority_sleeper optimization as a first patch.

V2->V3
- Rediff against 2.6.19-rc4-mm2
- Remove useless check for rq->idle in rebalance_domains()

-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/

Relevant Pages

  • [PATCH 0/7] sched_domain balancing via tasklet V2
    ... This patchset moves potentially expensive load balancing out of the scheduler ... Load balancing will then run with interrupts ... The moving of the load balancing into a tasklet also allows some ... no longer check all the sched domains on each tick. ...
    (Linux-Kernel)
  • [PATCH 0/5] On demand sched_domain balancing in tasklet
    ... This patchset moves potentially expensive load balancing out of the scheduler ... Load balancing will then run with interrupts ... The moving of the load balancing into a tasklet also allows some ... no longer check all the sched domains on each tick. ...
    (Linux-Kernel)
  • Re: + sched-use-tasklet-to-call-balancing.patch added to -mm tree
    ... smoothes out the load balancing load over all nodes in a NUMA system. ... It fixes the issues that we saw with contention during concurrent load ... Also, a tasklet can be ... which means that a CPU will do more rebalancing albeit ...
    (Linux-Kernel)
  • [PATCH 0/8] sched_domain balancing via softirq V4
    ... This patchset moves more or less expensive load balancing out of the scheduler ... tick into a softirq that is triggered ... small time since it is part of the timer tick processing. ...
    (Linux-Kernel)
  • RE: + sched-use-tasklet-to-call-balancing.patch added to -mm tree
    ... Having a global tasklet avoids ... we saw with contention during concurrent load balancing. ... running load balancing of the larger sched domains from all processors. ...
    (Linux-Kernel)