Peter Zijlstra dce840a087
sched: Dynamically allocate sched_domain/sched_group data-structures ...
Instead of relying on static allocations for the sched_domain and
sched_group trees, dynamically allocate and RCU free them.
Allocating this dynamically also allows for some build_sched_groups()
simplification since we can now (like with other simplifications) rely
on the sched_domain tree instead of hard-coded knowledge.
One tricky to note is that detach_destroy_domains() needs to hold
rcu_read_lock() over the entire tear-down, per-cpu is not sufficient
since that can lead to partial sched_group existance (could possibly
be solved by doing the tear-down backwards but this is much more
robust).
A concequence of the above is that we can no longer print the
sched_domain debug stuff from cpu_attach_domain() since that might now
run with preemption disabled (due to classic RCU etc.) and
sched_domain_debug() does some GFP_KERNEL allocations.
Another thing to note is that we now fully rely on normal RCU and not
RCU-sched, this is because with the new and exiting RCU flavours we
grew over the years BH doesn't necessarily hold off RCU-sched grace
periods (-rt is known to break this). This would in fact already cause
us grief since we do sched_domain/sched_group iterations from softirq
context.
This patch is somewhat larger than I would like it to be, but I didn't
find any means of shrinking/splitting this.
Signed-off-by: Peter Zijlstra <a.p.zijlstra@chello.nl >
Cc: Mike Galbraith <efault@gmx.de >
Cc: Nick Piggin <npiggin@kernel.dk >
Cc: Linus Torvalds <torvalds@linux-foundation.org >
Cc: Andrew Morton <akpm@linux-foundation.org >
Link: http://lkml.kernel.org/r/20110407122942.245307941@chello.nl
Signed-off-by: Ingo Molnar <mingo@elte.hu >
2011-04-11 12:58:19 +02:00
2011-03-31 11:26:23 -03:00
2011-01-30 01:14:14 -08:00
2011-03-31 11:26:23 -03:00
2011-03-29 12:11:16 -07:00
2011-03-31 11:26:23 -03:00
2011-03-23 10:42:00 +01:00
2011-03-18 23:38:50 -07:00
2011-03-31 11:26:23 -03:00
2010-12-16 12:37:26 -05:00
2011-03-31 11:26:23 -03:00
2011-03-23 12:24:23 -07:00
2011-03-31 11:26:23 -03:00
2011-03-31 11:26:23 -03:00
2011-03-31 11:26:23 -03:00
2011-03-31 11:26:23 -03:00
2011-01-20 17:50:17 +01:00
2011-01-20 17:50:17 +01:00
2011-01-13 08:03:19 -08:00
2011-03-31 11:26:23 -03:00
2011-03-16 15:11:04 -07:00
2011-03-01 22:24:19 +03:00
2011-03-31 11:26:23 -03:00
2011-03-26 14:15:06 +00:00
2011-03-31 11:26:23 -03:00
2011-02-18 16:54:54 -05:00
2011-03-31 11:26:23 -03:00
2011-01-13 08:03:08 -08:00
2011-04-07 11:14:49 -07:00
2011-03-31 11:26:23 -03:00
2011-02-24 19:58:42 +01:00
2011-01-20 18:30:17 -08:00
2011-03-21 22:59:08 -04:00
2011-03-15 02:42:32 -04:00
2011-01-31 14:03:00 -08:00
2011-03-30 16:53:38 -07:00
2011-01-19 23:51:37 +01:00
2011-01-15 20:07:45 -05:00
2010-12-06 15:58:43 -05:00
2011-03-10 08:52:07 +01:00
2011-03-22 17:43:59 -07:00
2011-03-11 14:25:50 +00:00
2011-01-10 13:31:14 -08:00
2011-01-13 08:03:12 -08:00
2011-03-08 08:28:01 +01:00
2011-01-07 17:50:31 +11:00
2011-03-10 08:52:27 +01:00
2011-04-05 23:52:43 +02:00
2011-03-03 10:53:20 -05:00
2011-03-23 19:47:19 -07:00
2011-03-10 08:52:07 +01:00
2011-03-23 19:47:06 -07:00
2011-01-13 08:03:17 -08:00
2011-03-31 11:26:23 -03:00
2010-12-16 17:53:38 +01:00
2011-03-31 11:26:23 -03:00
2011-02-16 13:30:48 +01:00
2011-03-31 11:26:23 -03:00
2011-03-31 11:26:23 -03:00
2010-12-20 09:07:35 -08:00
2011-03-22 17:44:00 -07:00
2011-03-22 17:44:10 -07:00
2011-03-22 17:44:10 -07:00
2011-03-22 17:44:10 -07:00
2011-01-05 14:15:50 +01:00
2011-03-31 11:26:23 -03:00
2011-03-30 17:14:33 -07:00
2011-01-26 10:50:06 +10:00
2011-03-31 11:26:23 -03:00
2011-01-24 14:51:56 -08:00
2011-03-16 17:54:33 -04:00
2011-01-12 12:47:34 -05:00
2011-01-13 08:03:22 -08:00
2011-03-22 17:44:15 -07:00
2011-03-23 19:47:02 -07:00
2011-01-13 08:03:13 -08:00
2011-03-22 19:25:05 -07:00
2011-03-21 12:13:10 -04:00
2011-03-14 17:02:43 -07:00
2011-01-20 17:01:09 -08:00
2011-01-10 08:51:44 -08:00
2011-03-08 16:10:38 +01:00
2011-03-10 08:52:07 +01:00
2011-03-23 22:16:41 +01:00
2011-03-24 13:54:30 +00:00
2011-01-13 19:59:52 +00:00
2011-03-31 11:26:23 -03:00
2011-02-25 12:00:34 -08:00
2011-03-31 11:26:23 -03:00
2011-03-10 11:35:17 +01:00
2011-03-10 11:35:15 +01:00
2011-03-31 11:26:23 -03:00
2011-03-07 01:12:28 +05:30
2011-02-03 15:39:16 -08:00
2011-03-14 08:40:51 -07:00
2011-04-05 23:51:37 +02:00
2011-03-22 17:44:11 -07:00
2011-01-13 21:49:56 -08:00
2011-03-31 11:26:23 -03:00
2011-03-31 11:26:23 -03:00
2011-03-31 11:26:23 -03:00
2011-03-23 19:46:17 -07:00
2011-01-12 20:16:43 -05:00
2010-12-15 13:56:33 -05:00
2011-03-31 11:26:23 -03:00
2011-03-14 19:12:20 -04:00
2011-01-09 15:42:55 -08:00
2011-03-15 02:21:45 -04:00
2010-12-08 10:30:34 -08:00
2011-03-31 11:26:23 -03:00
2011-03-21 10:05:22 -07:00
2011-01-10 08:51:44 -08:00
2011-02-03 15:39:17 -08:00
2011-02-16 17:48:59 +01:00
2011-01-07 17:50:27 +11:00
2011-04-07 11:14:49 -07:00
2011-03-31 11:26:23 -03:00
2011-03-31 11:26:23 -03:00
2011-01-07 17:50:23 +11:00
2011-01-07 17:50:23 +11:00
2011-03-10 10:31:48 -05:00
2011-02-11 16:23:33 -05:00
2010-12-07 20:16:56 +01:00
2011-01-07 17:50:29 +11:00
2011-03-22 08:35:35 +01:00
2011-03-22 17:44:05 -07:00
2010-12-06 17:15:15 -08:00
2011-01-10 22:11:23 +01:00
2011-01-14 08:06:39 -08:00
2011-03-05 10:56:00 +01:00
2011-02-03 16:37:28 +01:00
2011-03-31 11:26:23 -03:00
2011-02-11 15:05:49 +01:00
2010-12-17 15:18:04 +01:00
2011-03-31 11:26:23 -03:00
2011-03-10 19:15:58 +01:00
2011-02-15 15:21:11 -08:00
2011-02-17 09:52:03 -08:00
2011-02-23 00:53:26 +00:00
2011-03-20 14:50:53 +01:00
2011-03-31 11:26:23 -03:00
2011-03-12 15:08:54 -08:00
2011-03-09 16:10:56 -05:00
2011-01-11 23:55:51 +01:00
2011-01-06 11:10:05 -08:00
2011-01-19 23:31:09 -08:00
2011-03-18 15:14:45 -07:00
2011-02-27 16:11:51 -08:00
2011-03-10 16:37:26 -08:00
2011-02-10 07:51:44 -05:00
2011-02-18 12:42:28 -08:00
2011-01-06 10:23:33 -08:00
2011-01-31 21:17:41 -08:00
2011-03-28 06:05:21 -04:00
2011-03-31 11:26:23 -03:00
2010-12-17 10:01:09 -08:00
2011-03-23 19:47:08 -07:00
2010-12-14 00:21:51 -05:00
2011-03-31 11:26:23 -03:00
2011-03-30 00:37:41 +02:00
2011-03-29 14:48:19 +02:00
2011-03-31 11:26:23 -03:00
2011-03-20 21:13:43 -04:00
2010-12-09 20:17:07 -08:00
2011-03-31 11:26:23 -03:00
2011-03-20 20:08:48 -04:00
2011-03-24 08:36:10 +01:00
2011-03-22 16:17:32 -07:00
2011-03-22 04:53:54 -03:00
2011-02-17 11:12:40 -08:00
2011-01-13 17:32:31 -08:00
2011-03-22 17:44:14 -07:00
2011-04-01 16:14:30 +11:00
2011-03-08 11:17:18 +11:00
2011-03-08 11:17:18 +11:00
2011-03-08 11:17:22 +11:00
2011-03-18 16:54:31 +00:00
2011-01-13 17:32:47 -08:00
2011-02-13 16:54:24 -08:00
2011-01-24 14:45:11 +10:30
2011-01-13 08:03:07 -08:00
2011-02-18 08:02:10 -08:00
2011-01-07 17:02:58 -08:00
2011-01-07 08:43:37 +01:00
2011-03-22 17:44:01 -07:00
2011-03-31 11:26:23 -03:00
2011-03-17 13:08:30 -03:00
2011-01-12 11:23:08 +02:00
2011-01-12 11:23:12 +02:00
2011-03-31 11:26:23 -03:00
2011-01-13 08:03:06 -08:00
2011-01-13 08:03:05 -08:00
2011-03-25 21:00:29 -07:00
2011-03-31 11:26:23 -03:00
2011-01-14 13:12:45 +00:00
2011-02-18 11:32:28 -08:00
2011-01-21 13:38:57 -08:00
2011-03-31 11:26:23 -03:00
2011-03-18 22:33:38 -07:00
2011-01-10 19:04:08 +01:00
2010-12-06 11:03:46 -08:00
2011-03-22 04:53:56 -03:00
2011-03-23 19:46:25 -07:00
2011-01-15 13:28:17 +02:00
2011-02-03 16:08:57 -08:00
2011-02-14 17:38:30 -08:00
2011-01-13 17:32:34 -08:00
2011-01-13 17:32:46 -08:00
2011-03-22 17:44:03 -07:00
2011-03-31 11:26:23 -03:00
2011-01-13 17:32:46 -08:00
2011-02-15 10:24:31 +01:00
2011-02-21 15:21:53 -08:00
2011-01-24 14:32:52 +10:30
2011-01-16 13:47:07 -05:00
2011-03-31 11:26:23 -03:00
2011-01-30 01:14:38 -08:00
2011-03-02 13:43:15 -08:00
2011-03-18 09:04:20 -04:00
2011-01-12 20:03:43 -05:00
2011-01-12 20:03:43 -05:00
2011-02-22 10:19:31 -08:00
2011-04-01 20:23:25 -07:00
2011-01-18 16:08:30 +01:00
2011-03-03 13:32:07 -08:00
2010-12-16 12:37:23 -05:00
2011-03-31 11:26:23 -03:00
2011-03-11 15:39:27 -05:00
2011-03-23 15:29:04 -04:00
2011-03-11 15:39:26 -05:00
2011-03-11 15:38:44 -05:00
2011-03-27 17:48:07 +02:00
2011-03-24 17:03:14 -04:00
2011-01-25 15:24:47 -05:00
2011-03-10 17:29:40 +09:00
2011-03-31 11:26:23 -03:00
2010-12-22 22:15:32 +01:00
2011-02-03 16:08:57 -08:00
2011-03-31 11:26:23 -03:00
2010-12-23 15:57:48 -07:00
2011-02-28 01:36:38 -07:00
2011-01-15 22:01:58 -07:00
2011-02-04 11:46:50 -07:00
2011-03-23 14:55:56 -06:00
2011-03-16 17:28:10 -07:00
2011-03-31 11:26:23 -03:00
2011-02-15 11:10:20 +01:00
2011-03-31 11:26:23 -03:00
2011-03-22 17:44:03 -07:00
2011-03-24 10:16:26 -07:00
2011-03-14 02:58:03 -04:00
2011-01-16 13:47:07 -05:00
2011-03-31 08:51:38 +02:00
2011-03-31 11:26:23 -03:00
2011-01-16 11:56:26 -08:00
2011-03-21 09:40:43 -07:00
2011-03-21 09:38:02 -07:00
2011-02-28 11:20:03 +01:00
2011-04-07 11:14:49 -07:00
2011-03-09 11:59:33 -08:00
2011-03-31 11:26:23 -03:00
2011-01-10 07:38:54 -08:00
2011-03-31 11:26:23 -03:00
2011-02-18 08:15:51 -08:00
2011-03-11 15:13:26 -05:00
2011-03-15 00:43:14 +01:00
2011-03-15 00:43:14 +01:00
2011-03-23 22:16:41 +01:00
2011-03-31 11:26:23 -03:00
2011-01-25 15:24:47 -05:00
2011-02-02 15:28:20 +01:00
2011-02-02 15:28:20 +01:00
2011-03-01 22:27:26 +03:00
2011-01-13 08:03:21 -08:00
2011-01-13 08:03:21 -08:00
2011-03-31 11:26:23 -03:00
2011-01-13 08:03:10 -08:00
2011-03-23 19:46:37 -07:00
2010-12-28 14:25:21 -08:00
2011-03-04 09:23:30 -08:00
2011-03-22 17:44:00 -07:00
2011-03-31 11:26:23 -03:00
2011-01-12 19:14:55 +01:00
2011-03-24 21:16:31 -04:00
2011-01-13 17:32:48 -08:00
2011-01-14 02:36:43 +00:00
2010-12-17 12:34:59 -08:00
2011-04-01 07:27:31 -07:00
2011-03-31 11:26:23 -03:00
2011-02-01 11:12:29 -05:00
2011-03-23 19:46:23 -07:00
2011-03-09 13:52:27 -05:00
2011-03-23 19:46:41 -07:00
2011-01-13 08:03:18 -08:00
2011-02-25 15:07:37 -08:00
2011-03-23 19:46:43 -07:00
2011-03-22 17:44:03 -07:00
2011-01-13 08:03:23 -08:00
2011-03-09 11:23:37 -08:00
2011-01-27 12:30:38 +01:00
2011-01-27 12:30:39 +01:00
2011-01-27 12:30:40 +01:00
2010-12-22 02:39:57 +03:00
2011-04-11 12:58:19 +02:00
2011-03-23 19:47:02 -07:00
2011-01-07 17:50:27 +11:00
2011-01-13 08:03:19 -08:00
2011-01-19 15:37:31 +09:00
2011-03-22 17:44:15 -07:00
2011-04-07 11:14:49 -07:00
2011-01-23 21:00:05 +02:00
2011-03-22 20:48:04 +02:00
2011-03-22 17:16:34 +09:00
2011-03-31 11:26:23 -03:00
2011-03-23 07:48:42 -07:00
2010-12-08 12:16:33 -08:00
2011-03-31 11:26:23 -03:00
2011-03-09 14:08:09 -08:00
2011-03-28 06:05:24 -04:00
2011-03-31 11:26:23 -03:00
2011-01-27 12:30:38 +01:00
2011-03-31 11:26:23 -03:00
2011-03-31 11:26:23 -03:00
2011-03-31 11:26:23 -03:00
2011-03-15 00:43:16 +01:00
2011-03-22 15:47:22 +09:00
2011-03-24 10:16:26 -07:00
2011-03-21 00:40:29 -04:00
2011-03-15 00:43:46 +01:00
2011-03-09 16:43:24 -08:00
2011-03-31 11:26:23 -03:00
2011-01-24 09:33:36 -08:00
2010-12-22 19:43:34 -08:00
2011-02-28 18:00:31 -08:00
2011-02-02 15:28:13 +01:00
2011-02-04 12:41:21 -08:00
2011-02-21 12:53:08 -08:00
2011-03-31 11:26:23 -03:00
2011-02-02 15:28:18 +01:00
2011-03-13 16:35:18 -04:00
2011-02-23 18:05:11 -05:00
2011-01-13 08:03:08 -08:00
2011-03-31 11:26:23 -03:00
2011-02-03 09:28:46 -05:00
2011-02-17 11:59:56 -08:00
2011-01-13 08:03:20 -08:00
2011-03-22 16:17:32 -07:00
2011-03-22 17:44:09 -07:00
2011-03-31 11:26:23 -03:00
2010-12-20 09:37:33 +01:00
2011-03-31 11:26:23 -03:00
2011-01-13 08:03:18 -08:00
2011-03-23 19:47:03 -07:00
2011-03-31 11:26:23 -03:00
2011-03-22 04:53:37 -03:00
2011-03-22 04:53:33 -03:00
2011-01-06 13:05:04 +10:00
2011-03-31 11:26:23 -03:00
2010-12-11 02:01:35 -05:00
2011-03-22 04:54:51 -03:00
2011-01-24 14:45:11 +10:30
2011-02-09 08:19:55 +10:30
2011-03-28 12:53:29 +01:00
2011-03-22 17:44:05 -07:00
2011-02-17 11:13:19 -08:00
2011-03-31 11:26:23 -03:00
2011-02-21 10:07:23 +01:00
2011-03-24 21:17:51 -04:00
2011-01-17 08:05:27 -08:00
2011-03-13 20:22:28 -07:00
2011-03-31 11:26:23 -03:00
2011-01-13 08:03:24 -08:00
2011-03-22 17:44:17 -07:00
dce840a087