Re: [Lse-tech] [patch] sched-domain cleanups, sched-2.6.5-rc2-mm2-A3
From: Andi Kleen (ak_at_suse.de)
Date: 03/25/04
- Previous message: Arjan van de Ven: "Re: cciss updates [1 of 2]"
- In reply to: Nakajima, Jun: "RE: [Lse-tech] [patch] sched-domain cleanups, sched-2.6.5-rc2-mm2-A3"
- Next in thread: Ingo Molnar: "Re: [Lse-tech] [patch] sched-domain cleanups, sched-2.6.5-rc2-mm2-A3"
- Reply: Ingo Molnar: "Re: [Lse-tech] [patch] sched-domain cleanups, sched-2.6.5-rc2-mm2-A3"
- Reply: Ingo Molnar: "Re: [Lse-tech] [patch] sched-domain cleanups, sched-2.6.5-rc2-mm2-A3"
- Reply: Nick Piggin: "Re: [Lse-tech] [patch] sched-domain cleanups, sched-2.6.5-rc2-mm2-A3"
- Maybe reply: Nick Piggin: "Re: [Lse-tech] [patch] sched-domain cleanups, sched-2.6.5-rc2-mm2-A3"
- Maybe reply: Andi Kleen: "Re: [Lse-tech] [patch] sched-domain cleanups, sched-2.6.5-rc2-mm2-A3"
- Maybe reply: Nick Piggin: "Re: [Lse-tech] [patch] sched-domain cleanups, sched-2.6.5-rc2-mm2-A3"
- Maybe reply: Nick Piggin: "Re: [Lse-tech] [patch] sched-domain cleanups, sched-2.6.5-rc2-mm2-A3"
- Maybe reply: Ingo Molnar: "Re: [Lse-tech] [patch] sched-domain cleanups, sched-2.6.5-rc2-mm2-A3"
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
Date: Thu, 25 Mar 2004 16:40:11 +0100 To: "Nakajima, Jun" <jun.nakajima@intel.com>
On Thu, Mar 25, 2004 at 07:31:37AM -0800, Nakajima, Jun wrote:
> Andi,
>
> Can you be more specific with "it doesn't load balance threads
> aggressively enough"? Or what behavior of the base NUMA scheduler is
> missing in the sched-domain scheduler especially for NUMA?
It doesn't do load balance in wake_up_forked_process() and is relatively
non aggressive in balancing later. This leads to the multithreaded OpenMP
STREAM running its childs first on the same node as the original process
and allocating memory there. Then later they run on a different node when
the balancing finally happens, but generate cross traffic to the old node,
instead of using the memory bandwidth of their local nodes.
The difference is very visible, even the 4 thread STREAM only sees the
bandwidth of a single node. With a more aggressive scheduler you get
4 times as much.
Admittedly it's a bit of a stupid benchmark, but seems to representative
for a lot of HPC codes.
-Andi
-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/
- Previous message: Arjan van de Ven: "Re: cciss updates [1 of 2]"
- In reply to: Nakajima, Jun: "RE: [Lse-tech] [patch] sched-domain cleanups, sched-2.6.5-rc2-mm2-A3"
- Next in thread: Ingo Molnar: "Re: [Lse-tech] [patch] sched-domain cleanups, sched-2.6.5-rc2-mm2-A3"
- Reply: Ingo Molnar: "Re: [Lse-tech] [patch] sched-domain cleanups, sched-2.6.5-rc2-mm2-A3"
- Reply: Ingo Molnar: "Re: [Lse-tech] [patch] sched-domain cleanups, sched-2.6.5-rc2-mm2-A3"
- Reply: Nick Piggin: "Re: [Lse-tech] [patch] sched-domain cleanups, sched-2.6.5-rc2-mm2-A3"
- Maybe reply: Nick Piggin: "Re: [Lse-tech] [patch] sched-domain cleanups, sched-2.6.5-rc2-mm2-A3"
- Maybe reply: Andi Kleen: "Re: [Lse-tech] [patch] sched-domain cleanups, sched-2.6.5-rc2-mm2-A3"
- Maybe reply: Nick Piggin: "Re: [Lse-tech] [patch] sched-domain cleanups, sched-2.6.5-rc2-mm2-A3"
- Maybe reply: Nick Piggin: "Re: [Lse-tech] [patch] sched-domain cleanups, sched-2.6.5-rc2-mm2-A3"
- Maybe reply: Ingo Molnar: "Re: [Lse-tech] [patch] sched-domain cleanups, sched-2.6.5-rc2-mm2-A3"
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]