I'm unable to boot v3.15, but I can boot v3.15-rc8. I'm using a localmodconfig with IRQ and NMI debugging enabled, mostly because I see them near the end of the kernel panic. I tried bisecting but my last `git bisect good` ends with a commit that doesn't seem like it'd be a problem: 1860e379875dfe7271c649058aeddffe5afd9d0d is the first bad commit commit 1860e379875dfe7271c649058aeddffe5afd9d0d Author: Linus Torvalds <torvalds@linux-foundation.org> Date: Sun Jun 8 11:19:54 2014 -0700 Linux 3.15 :100644 100644 cdaa5b6a1c4d6e43e4c0c784831e1e3cb0d9fae5 6d1e304943a379c126c40e2aa1eb3bf4e872ecb1 M Makefile git bisect log # bad: [1860e379875dfe7271c649058aeddffe5afd9d0d] Linux 3.15 # good: [fad01e866afdbe01a1f3ec06a39c3a8b9e197014] Linux 3.15-rc8 git bisect start 'v3.15' 'v3.15-rc8' # good: [cae61ba37b4c2672704cbd8a626fbd85be7e67d9] Merge git://git.kernel.org/pub/scm/linux/kernel/git/davem/net git bisect good cae61ba37b4c2672704cbd8a626fbd85be7e67d9 # good: [951e273060d15b233a7f7ccaf76ba682b5b05a03] Merge branch 'perf-urgent-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip git bisect good 951e273060d15b233a7f7ccaf76ba682b5b05a03 # good: [813895f8dcb31bc6b0e9f5fc35e8c687a467f3dd] Merge branch 'x86/urgent' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip git bisect good 813895f8dcb31bc6b0e9f5fc35e8c687a467f3dd # good: [f1453773514bb8b0bba0716301e8c8f17f8d39c7] target: Fix alua_access_state attribute OOPs for un-configured devices git bisect good f1453773514bb8b0bba0716301e8c8f17f8d39c7 # good: [c593e8978722f7f4a12932733cfeed6c0c74fbaa] Merge branch 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/mason/linux-btrfs git bisect good c593e8978722f7f4a12932733cfeed6c0c74fbaa # good: [bb077d600689dbf9305758efed1e16775db1c84c] Revert "x86/smpboot: Initialize secondary CPU only if master CPU will wait for it" git bisect good bb077d600689dbf9305758efed1e16775db1c84 All the bisected kernels I built boot fine and I have no local commits on top of the v3.15 branch I have checked out. I have this same issue on two identical machines. [ 0.000000] Initializing cgroup subsys cpuset [ 0.000000] Initializing cgroup subsys cpu [ 0.000000] Initializing cgroup subsys cpuacct [ 0.000000] Linux version 3.15.0-2+ (root@mars) (gcc version 4.7.2 (Debian 4.7.2-5) ) #1 SMP Wed Jun 11 17:03:17 CDT 2014 [ 0.000000] e820: BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009dfff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009e000-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000003fffb9ff] usable [ 0.000000] BIOS-e820: [mem 0x000000003fffba00-0x000000003fffffff] ACPI data [ 0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000ffffffff] reserved [ 0.000000] Notice: NX (Execute Disable) protection missing in CPU! [ 0.000000] SMBIOS 2.3 present. [ 0.000000] e820: last_pfn = 0x3fffb max_arch_pfn = 0x100000 [ 0.000000] x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106 [ 0.000000] found SMP MP-table at [mem 0x0009e140-0x0009e14f] mapped at [c009e140] [ 0.000000] init_memory_mapping: [mem 0x00000000-0x000fffff] [ 0.000000] init_memory_mapping: [mem 0x37000000-0x373fffff] [ 0.000000] init_memory_mapping: [mem 0x30000000-0x36ffffff] [ 0.000000] init_memory_mapping: [mem 0x00100000-0x2fffffff] [ 0.000000] init_memory_mapping: [mem 0x37400000-0x377fdfff] [ 0.000000] RAMDISK: [mem 0x37882000-0x37c38fff] [ 0.000000] Allocated new RAMDISK: [mem 0x37447000-0x377fdcf3] [ 0.000000] Move RAMDISK from [mem 0x37882000-0x37c38cf3] to [mem 0x37447000-0x377fdcf3] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x000FDFC0 000014 (v00 IBM ) [ 0.000000] ACPI: RSDT 0x3FFFFF80 000030 (v01 IBM SERONYXP 00001000 IBM 45444F43) [ 0.000000] ACPI: FACP 0x3FFFFF00 000074 (v01 IBM SERONYXP 00001000 IBM 45444F43) [ 0.000000] ACPI: DSDT 0x3FFFBA00 0042FA (v01 IBM SERTURQU 00001000 MSFT 0100000B) [ 0.000000] ACPI: FACS 0x3FFFFE00 000040 [ 0.000000] ACPI: APIC 0x3FFFFE40 000092 (v01 IBM SERONYXP 00001000 IBM 45444F43) [ 0.000000] ACPI: ASF! 0x3FFFFD80 00004B (v16 IBM SERONYXP 00000001 IBM 45444F43) [ 0.000000] 135MB HIGHMEM available. [ 0.000000] 887MB LOWMEM available. [ 0.000000] mapped low ram: 0 - 377fe000 [ 0.000000] low ram: 0 - 377fe000 [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x00001000-0x00ffffff] [ 0.000000] Normal [mem 0x01000000-0x377fdfff] [ 0.000000] HighMem [mem 0x377fe000-0x3fffafff] [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x00001000-0x0009dfff] [ 0.000000] node 0: [mem 0x00100000-0x3fffafff] [ 0.000000] Using APIC driver default [ 0.000000] ACPI: PM-Timer IO Port: 0x488 [ 0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x06] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x01] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x07] enabled) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] dfl dfl lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] dfl dfl lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] dfl dfl lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] dfl dfl lint[0x1]) [ 0.000000] ACPI: IOAPIC (id[0x0e] address[0xfec00000] gsi_base[0]) [ 0.000000] IOAPIC[0]: apic_id 14, version 17, address 0xfec00000, GSI 0-15 [ 0.000000] ACPI: IOAPIC (id[0x0d] address[0xfec01000] gsi_base[16]) [ 0.000000] IOAPIC[1]: apic_id 13, version 17, address 0xfec01000, GSI 16-31 [ 0.000000] ACPI: IOAPIC (id[0x0c] address[0xfec02000] gsi_base[32]) [ 0.000000] IOAPIC[2]: apic_id 12, version 17, address 0xfec02000, GSI 32-47 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] e820: [mem 0x40000000-0xfebfffff] available for PCI devices [ 0.000000] setup_percpu: NR_CPUS:4 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] PERCPU: Embedded 12 pages/cpu @f6c10000 s27520 r0 d21632 u49152 [ 0.000000] Built 1 zonelists in Zone order, mobility grouping on. Total pages: 260264 [ 0.000000] Kernel command line: BOOT_IMAGE=/vmlinuz-3.15.0-2+ root=/dev/mapper/g-root ro console=ttyS0,115200n8 console=tty0 [ 0.000000] PID hash table entries: 4096 (order: 2, 16384 bytes) [ 0.000000] Dentry cache hash table entries: 131072 (order: 7, 524288 bytes) [ 0.000000] Inode-cache hash table entries: 65536 (order: 6, 262144 bytes) [ 0.000000] Initializing CPU#0 [ 0.000000] Initializing HighMem for node 0 (000377fe:0003fffb) [ 0.000000] Initializing Movable for node 0 (00000000:00000000) [ 0.000000] Memory: 1030484K/1048160K available (2671K kernel code, 230K rwdata, 884K rodata, 392K init, 344K bss, 17676K reserved, 139252K highmem) [ 0.000000] virtual kernel memory layout: [ 0.000000] fixmap : 0xfff67000 - 0xfffff000 ( 608 kB) [ 0.000000] pkmap : 0xff800000 - 0xffc00000 (4096 kB) [ 0.000000] vmalloc : 0xf7ffe000 - 0xff7fe000 ( 120 MB) [ 0.000000] lowmem : 0xc0000000 - 0xf77fe000 ( 887 MB) [ 0.000000] .init : 0xc13b6000 - 0xc1418000 ( 392 kB) [ 0.000000] .data : 0xc129c18c - 0xc13b4a00 (1122 kB) [ 0.000000] .text : 0xc1000000 - 0xc129c18c (2672 kB) [ 0.000000] Checking if this processor honours the WP bit even in supervisor mode...Ok. [ 0.000000] SLUB: HWalign=128, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] Hierarchical RCU implementation. [ 0.000000] NR_IRQS:2304 nr_irqs:1024 16 [ 0.000000] Console: colour VGA+ 80x25 [ 0.000000] console [tty0] enabled [ 0.000000] console [ttyS0] enabled [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 1993.730 MHz processor [ 0.012005] Calibrating delay loop (skipped), value calculated using timer frequency.. 3987.46 BogoMIPS (lpj=7974920) [ 0.020007] pid_max: default: 32768 minimum: 301 [ 0.024019] ACPI: Core revision 20140424 [ 0.034452] ACPI: All ACPI Tables successfully acquired [ 0.041020] Security Framework initialized [ 0.044028] Mount-cache hash table entries: 2048 (order: 1, 8192 bytes) [ 0.048008] Mountpoint-cache hash table entries: 2048 (order: 1, 8192 bytes) [ 0.056042] Initializing cgroup subsys devices [ 0.060018] Initializing cgroup subsys freezer [ 0.064011] Initializing cgroup subsys net_cls [ 0.068055] CPU: Physical Processor ID: 0 [ 0.072005] CPU: Processor Core ID: 0 [ 0.076007] mce: CPU supports 4 MCE banks [ 0.080017] CPU0: Thermal monitoring enabled (TM1) [ 0.084023] Last level iTLB entries: 4KB 64, 2MB 64, 4MB 64 [ 0.084023] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 64, 1GB 0 [ 0.084023] tlb_flushall_shift: 6 [ 0.088172] Freeing SMP alternatives memory: 16K (c1418000 - c141c000) [ 0.092143] Enabling APIC mode: Flat. Using 3 I/O APICs [ 0.100677] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.146611] smpboot: CPU0: Intel(R) Xeon(TM) CPU 2.00GHz (fam: 0f, model: 02, stepping: 07) [ 0.156000] Performance Events: Netburst events, Netburst P4/Xeon PMU driver. [ 0.158861] ... version: 0 [ 0.160004] ... bit width: 40 [ 0.164004] ... generic registers: 18 [ 0.168004] ... value mask: 000000ffffffffff [ 0.172004] ... max period: 0000007fffffffff [ 0.176004] ... fixed-purpose events: 0 [ 0.180004] ... event mask: 000000000003ffff [ 0.184639] x86: Booting SMP configuration: [ 0.188007] .... node #0, CPUs: #1 [ 0.016000] Initializing CPU#1 [ 0.288233] #2 [ 0.016000] Initializing CPU#2 [ 0.382279] #3 [ 0.016000] Initializing CPU#3 [ 0.478127] x86: Booted up 1 node, 4 CPUs [ 0.480005] ---------------- [ 0.484003] | NMI testsuite: [ 0.488003] -------------------- [ 0.492004] remote IPI: ok | [ 0.505096] local IPI: ok | [ 0.528014] -------------------- [ 0.531472] Good, all 2 testcases passed! | [ 0.532004] --------------------------------- [ 0.536006] smpboot: Total of 4 processors activated (15949.57 BogoMIPS) [ 0.544218] divide error: 0000 [#1] SMP [ 0.548000] Modules linked in: [ 0.548000] CPU: 2 PID: 6 Comm: kworker/u8:0 Not tainted 3.15.0-2+ #1 [ 0.548000] Hardware name: IBM eserver xSeries 335 -[867642X]-/, BIOS -[T2E114AUS-1.03]- 11/14/2002 [ 0.548000] task: f6461860 ti: f6484000 task.ti: f6484000 [ 0.548000] EIP: 0060:[<c10509c5>] EFLAGS: 00010046 CPU: 2 [ 0.548000] EIP is at find_busiest_group+0x18a/0x583 [ 0.548000] EAX: 00000000 EBX: f6485dac ECX: 00000000 EDX: 00000000 [ 0.548000] ESI: 00000004 EDI: 00000000 EBP: f6485de4 ESP: f6485d10 [ 0.548000] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 [ 0.548000] CR0: 8005003b CR2: 00000068 CR3: 0141f000 CR4: 000007d0 [ 0.548000] Stack: [ 0.548000] 00000000 00000001 00000002 000004c9 00000000 c1417280 ffffffff 00000000 [ 0.548000] f6c2e280 00000000 f6485e30 f6403600 000004c9 000002c1 000002c1 00000160 [ 0.548000] 0000024d 00000002 00000001 00000000 00000001 00000000 00000000 00000000 [ 0.548000] Call Trace: [ 0.548000] [<c1050ead>] load_balance+0xef/0x5c5 [ 0.548000] [<c104bd39>] ? sched_clock_local+0x11/0x139 [ 0.548000] [<c105192f>] pick_next_task_fair+0x2b4/0x3e0 [ 0.548000] [<c12949ea>] __schedule+0x206/0x62c [ 0.548000] [<c1294ce3>] ? __schedule+0x4ff/0x62c [ 0.548000] [<c1049e40>] ? default_wake_function+0xb/0xd [ 0.548000] [<c10553c7>] ? __wake_up_common+0x34/0x5a [ 0.548000] [<c1294e66>] schedule+0x56/0x58 [ 0.548000] [<c103dc81>] worker_thread+0x33e/0x390 [ 0.548000] [<c103d943>] ? pool_mayday_timeout+0xc1/0xc1 [ 0.548000] [<c10416d8>] kthread+0x9f/0xa4 [ 0.548000] [<c129b041>] ret_from_kernel_thread+0x21/0x30 [ 0.548000] [<c1041639>] ? kthread_freezable_should_stop+0x40/0x40 [ 0.548000] Code: 98 0e 00 3b 05 c0 1d 3b c1 89 c6 0f 8c 7b ff ff ff 8b 95 58 ff ff ff 8b 7b 14 8b 42 0c 31 d2 8b 48 04 8b 43 04 89 4b 10 c1 e0 0a <f7> f1 85 ff 89 85 38 ff ff ff 89 03 7 [ 0.548000] EIP: [<c10509c5>] find_busiest_group+0x18a/0x583 SS:ESP 0068:f6485d10 [ 0.548000] divide error: 0000 [#2] [ 0.548000] ---[ end trace abb3b3c980c32581 ]--- [ 0.548000] SMP [ 0.548000] Modules linked in: [ 0.548000] CPU: 0 PID: 2 Comm: kthreadd Tainted: G D 3.15.0-2+ #1 [ 0.548000] Hardware name: IBM eserver xSeries 335 -[867642X]-/, BIOS -[T2E114AUS-1.03]- 11/14/2002 [ 0.548000] task: f64604e0 ti: f6474000 task.ti: f6474000 [ 0.548000] EIP: 0060:[<c104d506>] EFLAGS: 00010046 CPU: 0 [ 0.548000] EIP is at select_task_rq_fair+0x3f5/0x546 [ 0.548000] EAX: 00000000 EBX: f6403600 ECX: f6403620 EDX: 00000000 [ 0.548000] ESI: f643cf00 EDI: 00000000 EBP: f6475f2c ESP: f6475ec8 [ 0.548000] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 [ 0.548000] CR0: 8005003b CR2: ffe67000 CR3: 0141f000 CR4: 000007d0 [ 0.548000] Stack: [ 0.548000] f6467500 00000002 00000000 f6475edc c108ab6b f6475f40 c102d6e2 f6403610 [ 0.548000] 00000070 00000008 00000000 00000264 f64604e0 00000000 c1417280 f6467500 [ 0.548000] 00000000 f6475f88 f64035c0 00000000 00000000 00000000 f6467500 c12a44e0 [ 0.548000] Call Trace: [ 0.548000] [<c108ab6b>] ? perf_event_fork+0xf/0x11 [ 0.548000] [<c102d6e2>] ? copy_process.part.42+0x1068/0x1255 [ 0.548000] [<c1049eaa>] wake_up_new_task+0x30/0xea [ 0.548000] [<c1041639>] ? kthread_freezable_should_stop+0x40/0x40 [ 0.548000] [<c102da8c>] do_fork+0x10c/0x237 [ 0.548000] [<c1049b5a>] ? do_set_cpus_allowed+0x2d/0x37 [ 0.548000] [<c1041639>] ? kthread_freezable_should_stop+0x40/0x40 [ 0.548000] [<c102dbd1>] kernel_thread+0x1a/0x1f [ 0.548000] [<c1041b45>] kthreadd+0xc7/0x10e [ 0.548000] [<c129b041>] ret_from_kernel_thread+0x21/0x30 [ 0.548000] [<c1041a7e>] ? kthread_create_on_cpu+0x44/0x44 [ 0.548000] Code: ff ff 8b 4d a0 01 45 f0 8b 45 b8 41 ba 04 00 00 00 e8 53 7d 0f 00 3b 05 c0 1d 3b c1 89 c1 7c c8 8b 45 f0 31 d2 8b 4b 0c c1 e0 0a <f7> 71 04 83 7d c4 00 75 07 3b 45 dc 6 [ 0.548000] EIP: [<c104d506>] select_task_rq_fair+0x3f5/0x546 SS:ESP 0068:f6475ec8 [ 0.548000] BUG: unable to handle kernel [ 0.548000] ---[ end trace abb3b3c980c32582 ]--- [ 0.548000] paging request at ffffffec [ 0.548000] IP: [<c1041997>] kthread_data+0xa/0xe [ 0.548000] *pde = 01421067 *pte = 00000000 [ 0.548000] Oops: 0000 [#3] SMP [ 0.548000] Modules linked in: [ 0.548000] CPU: 2 PID: 6 Comm: kworker/u8:0 Tainted: G D 3.15.0-2+ #1 [ 0.548000] Hardware name: IBM eserver xSeries 335 -[867642X]-/, BIOS -[T2E114AUS-1.03]- 11/14/2002 [ 0.548000] task: f6461860 ti: f6484000 task.ti: f6484000 [ 0.548000] EIP: 0060:[<c1041997>] EFLAGS: 00010002 CPU: 2 [ 0.548000] EIP is at kthread_data+0xa/0xe [ 0.548000] EAX: 00000000 EBX: 00000002 ECX: 00000001 EDX: 00000002 [ 0.548000] ESI: f6c2e280 EDI: 00000002 EBP: f6485b20 ESP: f6485b18 [ 0.548000] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 [ 0.548000] CR0: 8005003b CR2: 00000014 CR3: 0141f000 CR4: 000007d0 [ 0.548000] Stack: [ 0.548000] c103de32 f6461ad8 f6485b9c c12948da c102c677 f6485b44 f6485b6c c1417280 [ 0.548000] c1417280 f640e100 c10b925d f6461860 f730fd00 f6469b80 f6485b6c 00000246 [ 0.548000] 00406408 00000246 f6461860 f6461860 00000000 f6485b78 c10619ac 00000000 [ 0.548000] Call Trace: [ 0.548000] [<c103de32>] ? wq_worker_sleeping+0xb/0x76 [ 0.548000] [<c12948da>] __schedule+0xf6/0x62c [ 0.548000] [<c102c677>] ? __cleanup_sighand+0x1e/0x21 [ 0.548000] [<c10b925d>] ? kmem_cache_free+0xd0/0xd9 [ 0.548000] [<c10619ac>] ? call_rcu_sched+0xf/0x12 [ 0.548000] [<c102ed20>] ? release_task+0x387/0x399 [ 0.548000] [<c1294e66>] schedule+0x56/0x58 [ 0.548000] [<c103002f>] do_exit+0x75d/0x7b3 [ 0.548000] [<c12927ba>] ? printk+0x17/0x19 [ 0.548000] [<c1297b48>] oops_end+0x8e/0x96 [ 0.548000] [<c1004094>] die+0x54/0x5c [ 0.548000] [<c129772f>] do_trap+0x69/0xa4 [ 0.548000] [<c1002080>] ? math_state_restore+0x180/0x180 [ 0.548000] [<c10020ee>] do_divide_error+0x6e/0x78 [ 0.548000] [<c10509c5>] ? find_busiest_group+0x18a/0x583 [ 0.548000] [<c1297516>] error_code+0x5a/0x60 [ 0.548000] [<c1002080>] ? math_state_restore+0x180/0x180 [ 0.548000] [<c10509c5>] ? find_busiest_group+0x18a/0x583 [ 0.548000] [<c1050ead>] load_balance+0xef/0x5c5 [ 0.548000] [<c104bd39>] ? sched_clock_local+0x11/0x139 [ 0.548000] [<c105192f>] pick_next_task_fair+0x2b4/0x3e0 [ 0.548000] [<c12949ea>] __schedule+0x206/0x62c [ 0.548000] [<c1294ce3>] ? __schedule+0x4ff/0x62c [ 0.548000] [<c1049e40>] ? default_wake_function+0xb/0xd [ 0.548000] [<c10553c7>] ? __wake_up_common+0x34/0x5a [ 0.548000] [<c1294e66>] schedule+0x56/0x58 [ 0.548000] [<c103dc81>] worker_thread+0x33e/0x390 [ 0.548000] [<c103d943>] ? pool_mayday_timeout+0xc1/0xc1 [ 0.548000] [<c10416d8>] kthread+0x9f/0xa4 [ 0.548000] [<c129b041>] ret_from_kernel_thread+0x21/0x30 [ 0.548000] [<c1041639>] ? kthread_freezable_should_stop+0x40/0x40 [ 0.548000] Code: c4 3c 5b 5e 5f 5d c3 55 64 a1 ac 26 41 c1 8b 80 4c 02 00 00 89 e5 5d 8b 40 e4 c1 e8 02 83 e0 01 c3 55 8b 80 4c 02 00 00 89 e5 5d <8b> 40 ec c3 55 b9 04 00 00 00 89 e5 5 [ 0.548000] EIP: [<c1041997>] kthread_data+0xa/0xe SS:ESP 0068:f6485b18 [ 0.548000] CR2: 00000000ffffffec [ 0.548000] ---[ end trace abb3b3c980c32583 ]--- [ 0.552000] divide error: 0000 [#4] SMP [ 0.552000] Modules linked in: [ 0.552000] CPU: 0 PID: 1 Comm: swapper/0 Tainted: G D 3.15.0-2+ #1 [ 0.552000] Hardware name: IBM eserver xSeries 335 -[867642X]-/, BIOS -[T2E114AUS-1.03]- 11/14/2002 [ 0.552000] task: f6460000 ti: f644c000 task.ti: f644c000 [ 0.552000] EIP: 0060:[<c10509c5>] EFLAGS: 00010046 CPU: 0 [ 0.552000] EIP is at find_busiest_group+0x18a/0x583 [ 0.552000] EAX: 00000000 EBX: f644dc98 ECX: 00000000 EDX: 00000000 [ 0.552000] ESI: 00000004 EDI: ffffffff EBP: f644dd3c ESP: f644dc68 [ 0.552000] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 [ 0.552000] CR0: 8005003b CR2: ffe67000 CR3: 0141f000 CR4: 000007d0 [ 0.552000] Stack: [ 0.552000] 00000000 00000001 00000001 00000000 00000000 c1417280 00000000 00000000 [ 0.552000] f6c2e280 00000000 f644dd88 f6403600 00000000 00000000 00000000 00000000 [ 0.552000] 00000000 ffffffff 00000000 00000000 00000000 00000000 00000000 00000000 [ 0.552000] Call Trace: [ 0.552000] [<c1050ead>] load_balance+0xef/0x5c5 [ 0.552000] [<c104bd39>] ? sched_clock_local+0x11/0x139 [ 0.552000] [<c105192f>] pick_next_task_fair+0x2b4/0x3e0 [ 0.552000] [<c12949ea>] __schedule+0x206/0x62c [ 0.552000] [<c1294ce3>] ? __schedule+0x4ff/0x62c [ 0.552000] [<c104d84c>] ? check_preempt_wakeup+0x102/0x148 [ 0.552000] [<c1294e66>] schedule+0x56/0x58 [ 0.552000] [<c1294477>] schedule_timeout+0x17/0x10e [ 0.552000] [<c1047af7>] ? check_preempt_curr+0x27/0x62 [ 0.552000] [<c1047b43>] ? ttwu_do_wakeup+0x11/0xba [ 0.552000] [<c12954dd>] wait_for_common+0xc0/0xe3 [ 0.552000] [<c1049e35>] ? try_to_wake_up+0x1b7/0x1b7 [ 0.552000] [<c1295565>] wait_for_completion_killable+0x12/0x21 [ 0.552000] [<c1041768>] kthread_create_on_node+0x8b/0xf9 [ 0.552000] [<c103eb80>] __alloc_workqueue_key+0x21a/0x302 [ 0.552000] [<c103d67a>] ? process_scheduled_works+0x21/0x21 [ 0.552000] [<c13c7cb2>] usermodehelper_init+0x1a/0x2a [ 0.552000] [<c13b6a65>] kernel_init_freeable+0xb6/0x19d [ 0.552000] [<c129050f>] kernel_init+0x8/0xb8 [ 0.552000] [<c129b041>] ret_from_kernel_thread+0x21/0x30 [ 0.552000] [<c1290507>] ? rest_init+0x5f/0x5f [ 0.552000] Code: 98 0e 00 3b 05 c0 1d 3b c1 89 c6 0f 8c 7b ff ff ff 8b 95 58 ff ff ff 8b 7b 14 8b 42 0c 31 d2 8b 48 04 8b 43 04 89 4b 10 c1 e0 0a <f7> f1 85 ff 89 85 38 ff ff ff 89 03 7 [ 0.552000] EIP: [<c10509c5>] find_busiest_group+0x18a/0x583 SS:ESP 0068:f644dc68 [ 0.552000] ---[ end trace abb3b3c980c32584 ]--- [ 0.552000] divide error: 0000 [#5] SMP [ 0.552000] Modules linked in: [ 0.552000] CPU: 1 PID: 0 Comm: swapper/1 Tainted: G D 3.15.0-2+ #1 [ 0.552000] Hardware name: IBM eserver xSeries 335 -[867642X]-/, BIOS -[T2E114AUS-1.03]- 11/14/2002 [ 0.552000] task: f6462be0 ti: f648c000 task.ti: f648c000 [ 0.552000] EIP: 0060:[<c10509c5>] EFLAGS: 00210246 CPU: 1 [ 0.552000] EIP is at find_busiest_group+0x18a/0x583 [ 0.552000] EAX: 00000000 EBX: f64a5e38 ECX: 00000000 EDX: 00000000 [ 0.552000] ESI: 00000004 EDI: ffffffff EBP: f64a5edc ESP: f64a5e08 [ 0.552000] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 [ 0.552000] CR0: 8005003b CR2: 00000000 CR3: 0141f000 CR4: 000007d0 [ 0.552000] Stack: [ 0.552000] 00000000 00000001 00000001 00000000 00000000 c1417280 00000000 00000001 [ 0.552000] f6c2e280 00000000 f64a5f28 f6403600 00000000 00000000 00000000 00000000 [ 0.552000] 00000000 ffffffff 00000000 00000000 00000000 00000000 00000000 00000000 [ 0.552000] Call Trace: [ 0.552000] [<c1050ead>] load_balance+0xef/0x5c5 [ 0.552000] [<c104e21b>] ? update_blocked_averages+0x551/0x559 [ 0.552000] [<c10514b8>] rebalance_domains+0x135/0x1ec [ 0.552000] [<c105159d>] run_rebalance_domains+0x2e/0x10c [ 0.552000] [<c1031445>] __do_softirq+0x91/0x174 [ 0.552000] [<c10313b4>] ? __hrtimer_tasklet_trampoline+0x1a/0x1a [ 0.552000] [<c10032ff>] do_softirq_own_stack+0x1d/0x23 [ 0.552000] <IRQ> [ 0.552000] [<c1031667>] irq_exit+0x34/0x75 [ 0.552000] [<c102148d>] smp_apic_timer_interrupt+0x33/0x3d [ 0.552000] [<c12972ed>] apic_timer_interrupt+0x2d/0x34 [ 0.552000] [<c104007b>] ? param_set_charp+0x51/0x9e [ 0.552000] [<c10076b5>] ? default_idle+0x5/0x7 [ 0.552000] [<c1007bcd>] arch_cpu_idle+0x9/0xb [ 0.552000] [<c1055aad>] cpu_startup_entry+0xe6/0x1c9 [ 0.552000] [<c101ffad>] start_secondary+0x1a6/0x1ab [ 0.552000] Code: 98 0e 00 3b 05 c0 1d 3b c1 89 c6 0f 8c 7b ff ff ff 8b 95 58 ff ff ff 8b 7b 14 8b 42 0c 31 d2 8b 48 04 8b 43 04 89 4b 10 c1 e0 0a <f7> f1 85 ff 89 85 38 ff ff ff 89 03 7 [ 0.552000] EIP: [<c10509c5>] find_busiest_group+0x18a/0x583 SS:ESP 0068:f64a5e08 [ 0.552005] divide error: 0000 [#6] SMP [ 0.552005] ---[ end trace abb3b3c980c32585 ]--- [ 0.552000] [ 0.552010] Modules linked in: [ 0.552010] Kernel panic - not syncing: Fatal exception in interrupt [ 0.552000] [ 0.552000] CPU: 3 PID: 0 Comm: swapper/3 Tainted: G D 3.15.0-2+ #1 [ 0.552000] Hardware name: IBM eserver xSeries 335 -[867642X]-/, BIOS -[T2E114AUS-1.03]- 11/14/2002 [ 0.552000] task: f64635a0 ti: f6490000 task.ti: f6490000 [ 0.552000] EIP: 0060:[<c10509c5>] EFLAGS: 00210246 CPU: 3 [ 0.552000] EIP is at find_busiest_group+0x18a/0x583 [ 0.552000] EAX: 00000000 EBX: f64cde38 ECX: 00000000 EDX: 00000000 [ 0.552000] ESI: 00000004 EDI: ffffffff EBP: f64cdedc ESP: f64cde08 [ 0.552000] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 [ 0.552000] CR0: 8005003b CR2: 00000000 CR3: 0141f000 CR4: 000007d0 [ 0.552000] Stack: [ 0.552000] 00000000 00000001 00000001 00000000 00000000 c1417280 00000000 00000001 [ 0.552000] f6c2e280 00000000 f64cdf28 f6403600 00000000 00000000 00000000 00000000 [ 0.552000] 00000000 ffffffff 00000000 00000000 00000000 00000000 00000000 00000000 [ 0.552000] Call Trace: [ 0.552000] [<c1050ead>] load_balance+0xef/0x5c5 [ 0.552000] [<c104e21b>] ? update_blocked_averages+0x551/0x559 [ 0.552000] [<c10514b8>] rebalance_domains+0x135/0x1ec [ 0.552000] [<c105159d>] run_rebalance_domains+0x2e/0x10c [ 0.552000] [<c1031445>] __do_softirq+0x91/0x174 [ 0.552000] [<c10313b4>] ? __hrtimer_tasklet_trampoline+0x1a/0x1a [ 0.552000] [<c10032ff>] do_softirq_own_stack+0x1d/0x23 [ 0.552000] <IRQ> [ 0.552000] [<c1031667>] irq_exit+0x34/0x75 [ 0.552000] [<c102148d>] smp_apic_timer_interrupt+0x33/0x3d [ 0.552000] [<c12972ed>] apic_timer_interrupt+0x2d/0x34 [ 0.552000] [<c104007b>] ? param_set_charp+0x51/0x9e [ 0.552000] [<c10076b5>] ? default_idle+0x5/0x7 [ 0.552000] [<c1007bcd>] arch_cpu_idle+0x9/0xb [ 0.552000] [<c1055aad>] cpu_startup_entry+0xe6/0x1c9 [ 0.552000] [<c101ffad>] start_secondary+0x1a6/0x1ab [ 0.552000] Code: 98 0e 00 3b 05 c0 1d 3b c1 89 c6 0f 8c 7b ff ff ff 8b 95 58 ff ff ff 8b 7b 14 8b 42 0c 31 d2 8b 48 04 8b 43 04 89 4b 10 c1 e0 0a <f7> f1 85 ff 89 85 38 ff ff ff 89 03 7 [ 0.552000] EIP: [<c10509c5>] find_busiest_group+0x18a/0x583 SS:ESP 0068:f64cde08 [ 0.552467] divide error: 0000 [#7] SMP [ 0.552470] Modules linked in: [ 0.552474] CPU: 0 PID: 7 Comm: rcu_sched Tainted: G D 3.15.0-2+ #1 [ 0.552478] Hardware name: IBM eserver xSeries 335 -[867642X]-/, BIOS -[T2E114AUS-1.03]- 11/14/2002 [ 0.552481] task: f6461d40 ti: f6486000 task.ti: f6486000 [ 0.552484] EIP: 0060:[<c10509c5>] EFLAGS: 00010046 CPU: 0 [ 0.552488] EIP is at find_busiest_group+0x18a/0x583 [ 0.552491] EAX: 00000000 EBX: f6487cf4 ECX: 00000000 EDX: 00000000 [ 0.552494] ESI: 00000004 EDI: ffffffff EBP: f6487d98 ESP: f6487cc4 [ 0.552496] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 [ 0.552499] CR0: 8005003b CR2: ffe67000 CR3: 0141f000 CR4: 000007d0 [ 0.552501] Stack: [ 0.552509] 00000000 00000001 00000001 00000000 00000000 c1417280 00000000 00000000 [ 0.552517] f6c2e280 00000000 f6487de4 f6403600 00000000 00000000 00000000 00000000 [ 0.552525] 00000000 ffffffff 00000000 00000000 00000000 00000000 00000000 00000000 [ 0.552526] Call Trace: [ 0.552535] [<c1050ead>] load_balance+0xef/0x5c5 [ 0.552540] [<c104bd39>] ? sched_clock_local+0x11/0x139 [ 0.552546] [<c105192f>] pick_next_task_fair+0x2b4/0x3e0 [ 0.552552] [<c12949ea>] __schedule+0x206/0x62c [ 0.552557] [<c1294ce3>] ? __schedule+0x4ff/0x62c [ 0.552565] [<c1034daf>] ? lock_timer_base.isra.31+0x1e/0x3c [ 0.552570] [<c1294e66>] schedule+0x56/0x58 [ 0.552575] [<c129454d>] schedule_timeout+0xed/0x10e [ 0.552580] [<c1034ccc>] ? usleep_range+0x3a/0x3a [ 0.552586] [<c106108f>] rcu_gp_kthread+0x262/0x4af [ 0.552592] [<c10557f7>] ? __wake_up_sync+0xd/0xd [ 0.552597] [<c1060e2d>] ? force_qs_rnp+0x10c/0x10c [ 0.552602] [<c10416d8>] kthread+0x9f/0xa4 [ 0.552608] [<c129b041>] ret_from_kernel_thread+0x21/0x30 [ 0.552613] [<c1041639>] ? kthread_freezable_should_stop+0x40/0x40 [ 0.552660] Code: 98 0e 00 3b 05 c0 1d 3b c1 89 c6 0f 8c 7b ff ff ff 8b 95 58 ff ff ff 8b 7b 14 8b 42 0c 31 d2 8b 48 04 8b 43 04 89 4b 10 c1 e0 0a <f7> f1 85 ff 89 85 38 ff ff ff 89 03 7 [ 0.552667] EIP: [<c10509c5>] find_busiest_group+0x18a/0x583 SS:ESP 0068:f6487cc4 [ 0.552670] ---[ end trace abb3b3c980c32586 ]--- [ 0.548000] Fixing recursive fault but reboot is needed! [ 0.556000] Shutting down cpus with NMI [ 0.556000] ---[ end Kernel panic - not syncing: Fatal exception in interrupt
Same with 3.16-rc4: [ 0.000000] Initializing cgroup subsys cpuset [ 0.000000] Initializing cgroup subsys cpu [ 0.000000] Initializing cgroup subsys cpuacct [ 0.000000] Linux version 3.16.0-rc4-1+ (root@mars) (gcc version 4.7.2 (Debian 4.7.2-5) ) #1 SMP Mon Jul 7 20:33:20 CDT 2014 [ 0.000000] e820: BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009dfff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009e000-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000003fffb9ff] usable [ 0.000000] BIOS-e820: [mem 0x000000003fffba00-0x000000003fffffff] ACPI data [ 0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000ffffffff] reserved [ 0.000000] Notice: NX (Execute Disable) protection missing in CPU! [ 0.000000] SMBIOS 2.3 present. [ 0.000000] e820: last_pfn = 0x3fffb max_arch_pfn = 0x1000000 [ 0.000000] x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106 [ 0.000000] found SMP MP-table at [mem 0x0009e140-0x0009e14f] mapped at [c009e140] [ 0.000000] init_memory_mapping: [mem 0x00000000-0x000fffff] [ 0.000000] init_memory_mapping: [mem 0x37200000-0x373fffff] [ 0.000000] init_memory_mapping: [mem 0x34000000-0x371fffff] [ 0.000000] init_memory_mapping: [mem 0x00100000-0x33ffffff] [ 0.000000] init_memory_mapping: [mem 0x37400000-0x379fdfff] [ 0.000000] RAMDISK: [mem 0x37538000-0x37a93fff] [ 0.000000] Allocated new RAMDISK: [mem 0x36fdc000-0x37537496] [ 0.000000] Move RAMDISK from [mem 0x37538000-0x37a93496] to [mem 0x36fdc000-0x37537496] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x000FDFC0 000014 (v00 IBM ) [ 0.000000] ACPI: RSDT 0x3FFFFF80 000030 (v01 IBM SERONYXP 00001000 IBM 45444F43) [ 0.000000] ACPI: FACP 0x3FFFFF00 000074 (v01 IBM SERONYXP 00001000 IBM 45444F43) [ 0.000000] ACPI: DSDT 0x3FFFBA00 0042FA (v01 IBM SERTURQU 00001000 MSFT 0100000B) [ 0.000000] ACPI: FACS 0x3FFFFE00 000040 [ 0.000000] ACPI: APIC 0x3FFFFE40 000092 (v01 IBM SERONYXP 00001000 IBM 45444F43) [ 0.000000] ACPI: ASF! 0x3FFFFD80 00004B (v16 IBM SERONYXP 00000001 IBM 45444F43) [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000003fffafff] [ 0.000000] Initmem setup node 0 [mem 0x00000000-0x3fffafff] [ 0.000000] NODE_DATA [mem 0x379fc000-0x379fdfff] [ 0.000000] 133MB HIGHMEM available. [ 0.000000] 889MB LOWMEM available. [ 0.000000] mapped low ram: 0 - 379fe000 [ 0.000000] low ram: 0 - 379fe000 [ 0.000000] Node: 0, start_pfn: 1, end_pfn: 9e [ 0.000000] Node: 0, start_pfn: 100, end_pfn: 3fffb [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x00001000-0x00ffffff] [ 0.000000] Normal [mem 0x01000000-0x379fdfff] [ 0.000000] HighMem [mem 0x379fe000-0x3fffafff] [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x00001000-0x0009dfff] [ 0.000000] node 0: [mem 0x00100000-0x3fffafff] [ 0.000000] Using APIC driver default [ 0.000000] ACPI: PM-Timer IO Port: 0x488 [ 0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x06] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x01] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x07] enabled) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] dfl dfl lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] dfl dfl lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] dfl dfl lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] dfl dfl lint[0x1]) [ 0.000000] ACPI: IOAPIC (id[0x0e] address[0xfec00000] gsi_base[0]) [ 0.000000] IOAPIC[0]: apic_id 14, version 17, address 0xfec00000, GSI 0-15 [ 0.000000] ACPI: IOAPIC (id[0x0d] address[0xfec01000] gsi_base[16]) [ 0.000000] IOAPIC[1]: apic_id 13, version 17, address 0xfec01000, GSI 16-31 [ 0.000000] ACPI: IOAPIC (id[0x0c] address[0xfec02000] gsi_base[32]) [ 0.000000] IOAPIC[2]: apic_id 12, version 17, address 0xfec02000, GSI 32-47 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x0009e000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.000000] e820: [mem 0x40000000-0xfebfffff] available for PCI devices [ 0.000000] setup_percpu: NR_CPUS:32 nr_cpumask_bits:32 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] PERCPU: Embedded 13 pages/cpu @f79c1000 s31424 r0 d21824 u53248 [ 0.000000] Built 1 zonelists in Zone order, mobility grouping on. Total pages: 260260 [ 0.000000] Policy zone: HighMem [ 0.000000] Kernel command line: BOOT_IMAGE=/vmlinuz-3.16.0-rc4-1+ root=/dev/mapper/g-root ro console=ttyS0,115200n8 console=tty0 [ 0.000000] PID hash table entries: 4096 (order: 2, 16384 bytes) [ 0.000000] Dentry cache hash table entries: 131072 (order: 7, 524288 bytes) [ 0.000000] Inode-cache hash table entries: 65536 (order: 6, 262144 bytes) [ 0.000000] Initializing CPU#0 [ 0.000000] Initializing HighMem for node 0 (000379fe:0003fffb) [ 0.000000] Initializing Movable for node 0 (00000000:00000000) [ 0.000000] Memory: 1027736K/1048160K available (3087K kernel code, 344K rwdata, 1236K rodata, 444K init, 424K bss, 20424K reserved, 137204K highmem) [ 0.000000] virtual kernel memory layout: [ 0.000000] fixmap : 0xffd37000 - 0xfffff000 (2848 kB) [ 0.000000] pkmap : 0xffa00000 - 0xffc00000 (2048 kB) [ 0.000000] vmalloc : 0xf81fe000 - 0xff9fe000 ( 120 MB) [ 0.000000] lowmem : 0xc0000000 - 0xf79fe000 ( 889 MB) [ 0.000000] .init : 0xc1493000 - 0xc1502000 ( 444 kB) [ 0.000000] .data : 0xc13042d1 - 0xc1491300 (1588 kB) [ 0.000000] .text : 0xc1000000 - 0xc13042d1 (3088 kB) [ 0.000000] Checking if this processor honours the WP bit even in supervisor mode...Ok. [ 0.000000] Hierarchical RCU implementation. [ 0.000000] RCU dyntick-idle grace-period acceleration is enabled. [ 0.000000] RCU restricting CPUs from NR_CPUS=32 to nr_cpu_ids=4. [ 0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS:2304 nr_irqs:1024 16 [ 0.000000] Console: colour VGA+ 80x25 [ 0.000000] console [tty0] enabled [ 0.000000] console [ttyS0] enabled [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 1993.730 MHz processor [ 0.012004] Calibrating delay loop (skipped), value calculated using timer frequency.. 3987.46 BogoMIPS (lpj=7974920) [ 0.020006] pid_max: default: 32768 minimum: 301 [ 0.024024] ACPI: Core revision 20140424 [ 0.034335] ACPI: All ACPI Tables successfully acquired [ 0.040072] Security Framework initialized [ 0.044012] AppArmor: AppArmor disabled by boot time parameter [ 0.048031] Mount-cache hash table entries: 2048 (order: 1, 8192 bytes) [ 0.052008] Mountpoint-cache hash table entries: 2048 (order: 1, 8192 bytes) [ 0.056530] Initializing cgroup subsys devices [ 0.060023] Initializing cgroup subsys freezer [ 0.064009] Initializing cgroup subsys net_cls [ 0.068016] Initializing cgroup subsys blkio [ 0.072013] Initializing cgroup subsys perf_event [ 0.076053] CPU: Physical Processor ID: 0 [ 0.080005] CPU: Processor Core ID: 0 [ 0.083743] mce: CPU supports 4 MCE banks [ 0.088014] CPU0: Thermal monitoring enabled (TM1) [ 0.092021] Last level iTLB entries: 4KB 64, 2MB 64, 4MB 64 [ 0.092021] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 64, 1GB 0 [ 0.092021] tlb_flushall_shift: 6 [ 0.100121] Freeing SMP alternatives memory: 12K (c1502000 - c1505000) [ 0.104152] Enabling APIC mode: Flat. Using 3 I/O APICs [ 0.108808] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.154928] smpboot: CPU0: Intel(R) Xeon(TM) CPU 2.00GHz (fam: 0f, model: 02, stepping: 07) [ 0.164000] Performance Events: Netburst events, Netburst P4/Xeon PMU driver. [ 0.166712] ... version: 0 [ 0.168004] ... bit width: 40 [ 0.172003] ... generic registers: 18 [ 0.176003] ... value mask: 000000ffffffffff [ 0.180003] ... max period: 0000007fffffffff [ 0.184003] ... fixed-purpose events: 0 [ 0.188003] ... event mask: 000000000003ffff [ 0.192881] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter. [ 0.196320] x86: Booting SMP configuration: [ 0.200006] .... node #0, CPUs: #1 [ 0.016000] Initializing CPU#1 [ 0.300399] #2 [ 0.016000] Initializing CPU#2 [ 0.394446] #3 [ 0.016000] Initializing CPU#3 [ 0.490182] x86: Booted up 1 node, 4 CPUs [ 0.492006] smpboot: Total of 4 processors activated (15949.47 BogoMIPS) [ 0.497054] divide error: 0000 [#1] SMP [ 0.500000] Modules linked in: [ 0.500000] CPU: 2 PID: 6 Comm: kworker/u8:0 Not tainted 3.16.0-rc4-1+ #1 [ 0.500000] Hardware name: IBM eserver xSeries 335 -[867642X]-/, BIOS -[T2E114AUS-1.03]- 11/14/2002 [ 0.500000] task: f604b010 ti: f607e000 task.ti: f607e000 [ 0.500000] EIP: 0060:[<c1054dbc>] EFLAGS: 00010046 CPU: 2 [ 0.500000] EIP is at update_sd_lb_stats+0x134/0x286 [ 0.500000] EAX: 00000000 EBX: f607fdb4 ECX: 00000000 EDX: 00000000 [ 0.500000] ESI: 00000020 EDI: 00000000 EBP: f6097e60 ESP: f607fd10 [ 0.500000] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 [ 0.500000] CR0: 8005003b CR2: 00000068 CR3: 01508000 CR4: 000007f0 [ 0.500000] Stack: [ 0.500000] f607fe30 f607fd74 00000000 00000000 ffffffff c1501300 00000000 000006f5 [ 0.500000] 00000002 000006f5 000003ff 000003ff 000001ff 0000024c 00000002 00000001 [ 0.500000] 00000000 00000001 00000000 00000000 f607fe30 f6097e60 f607fde0 f613c000 [ 0.500000] Call Trace: [ 0.500000] [<c1054f2b>] ? find_busiest_group+0x1d/0x159 [ 0.500000] [<c105516d>] ? load_balance+0x106/0x648 [ 0.500000] [<c1051a1d>] ? sched_clock_local+0x11/0x139 [ 0.500000] [<c10558dd>] ? pick_next_task_fair+0x22e/0x31d [ 0.500000] [<c104c72e>] ? pick_next_task+0x27/0x63 [ 0.500000] [<c1300714>] ? __schedule+0x1e7/0x4c8 [ 0.500000] [<c1300907>] ? __schedule+0x3da/0x4c8 [ 0.500000] [<c1059376>] ? __wake_up_common+0x33/0x59 [ 0.500000] [<c1041f53>] ? worker_thread+0x283/0x2e1 [ 0.500000] [<c1041cd0>] ? process_scheduled_works+0x1d/0x1d [ 0.500000] [<c1045c6e>] ? kthread+0x7c/0x81 [ 0.500000] [<c1302941>] ? ret_from_kernel_thread+0x21/0x30 [ 0.500000] [<c1045bf2>] ? __kthread_parkme+0x4c/0x4c [ 0.500000] Code: 8d 55 10 8b 48 24 89 f0 e8 50 58 13 00 3b 05 24 d4 48 c1 89 c6 7c 95 8b 45 0c 31 d2 8b 7b 14 8b 48 04 8b 43 04 89 4b 10 c1 e0 0a <f7> f1 85 ff 89 44 24 1c 89 03 74 0a 3 [ 0.500000] EIP: [<c1054dbc>] update_sd_lb_stats+0x134/0x286 SS:ESP 0068:f607fd10 [ 0.500000] divide error: 0000 [#2] [ 0.500000] ---[ end trace 8420372b05e90bf4 ]--- [ 0.500000] SMP [ 0.500000] Modules linked in: [ 0.500000] CPU: 0 PID: 2 Comm: kthreadd Tainted: G D 3.16.0-rc4-1+ #1 [ 0.500000] Hardware name: IBM eserver xSeries 335 -[867642X]-/, BIOS -[T2E114AUS-1.03]- 11/14/2002 [ 0.500000] task: f6046520 ti: f6070000 task.ti: f6070000 [ 0.500000] EIP: 0060:[<c1053d82>] EFLAGS: 00010046 CPU: 0 [ 0.500000] EIP is at select_task_rq_fair+0x457/0x5ad [ 0.500000] EAX: 00000000 EBX: f613c100 ECX: f6097e40 EDX: 00000000 [ 0.500000] ESI: f6097e60 EDI: 00000000 EBP: 00000000 ESP: f6071ec8 [ 0.500000] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 [ 0.500000] CR0: 8005003b CR2: ffc37000 CR3: 01508000 CR4: 000007f0 [ 0.500000] Stack: [ 0.500000] ffffffff 00000001 f604ad8c 00000002 00000000 00000000 00000000 f61425ac [ 0.500000] f6097ea0 f6143520 00000000 00000000 c1501300 00000000 c104c627 0000037a [ 0.500000] 00000008 00000070 f6097e70 c145df54 f6046520 00000000 f6143520 c130fef8 [ 0.500000] Call Trace: [ 0.500000] [<c104c627>] ? mmdrop+0xb/0x19 [ 0.500000] [<c104fccf>] ? select_task_rq+0xe/0x3d [ 0.500000] [<c104fee6>] ? wake_up_new_task+0x28/0xad [ 0.500000] [<c10304a1>] ? do_fork+0x136/0x204 [ 0.500000] [<c104ca55>] ? cpumask_weight+0x7/0x8 [ 0.500000] [<c104b2bc>] ? task_rq_unlock+0xb/0x1a [ 0.500000] [<c1045bf2>] ? __kthread_parkme+0x4c/0x4c [ 0.500000] [<c1030586>] ? kernel_thread+0x17/0x1b [ 0.500000] [<c104618c>] ? kthreadd+0xe6/0x12a [ 0.500000] [<c1302941>] ? ret_from_kernel_thread+0x21/0x30 [ 0.500000] [<c10460a6>] ? kthread_create_on_cpu+0x4b/0x4b [ 0.500000] Code: ff ff 8b 4c 24 0c 01 44 24 10 8b 54 24 48 89 c8 e8 b0 eb ff ff 3b 05 24 d4 48 c1 89 c1 7c c6 8b 44 24 10 31 d2 8b 4e 0c c1 e0 0a <f7> 71 04 83 7c 24 28 00 75 08 3b 44 4 [ 0.500000] EIP: [<c1053d82>] select_task_rq_fair+0x457/0x5ad SS:ESP 0068:f6071ec8 [ 0.500000] ---[ end trace 8420372b05e90bf5 ]--- [ 0.500000] BUG: unable to handle kernel paging request at ffffffec [ 0.500000] IP: [<c1045fbd>] kthread_data+0x6/0xa [ 0.500000] *pdpt = 0000000001505001 *pde = 000000000157f067 *pte = 0000000000000000 [ 0.500000] Oops: 0000 [#3] SMP [ 0.500000] Modules linked in: [ 0.500000] CPU: 2 PID: 6 Comm: kworker/u8:0 Tainted: G D 3.16.0-rc4-1+ #1 [ 0.500000] Hardware name: IBM eserver xSeries 335 -[867642X]-/, BIOS -[T2E114AUS-1.03]- 11/14/2002 [ 0.500000] task: f604b010 ti: f607e000 task.ti: f607e000 [ 0.500000] EIP: 0060:[<c1045fbd>] EFLAGS: 00010002 CPU: 2 [ 0.500000] EIP is at kthread_data+0x6/0xa [ 0.500000] EAX: 00000000 EBX: f79e2300 ECX: f607fb00 EDX: 00000002 [ 0.500000] ESI: 00000002 EDI: f604b2a4 EBP: f604b010 ESP: f607fb50 [ 0.500000] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 [ 0.500000] CR0: 8005003b CR2: 00000014 CR3: 01508000 CR4: 000007f0 [ 0.500000] Stack: [ 0.500000] c104247d f79e2300 00000002 c130061b 00000007 00000001 f607fb94 00000008 [ 0.500000] c1501300 f6054400 f6003700 c1501300 00000000 f6081700 00000246 00000246 [ 0.500000] 0004b010 f604b010 f604b010 00000000 00000000 c106c170 00000000 c1031896 [ 0.500000] Call Trace: [ 0.500000] [<c104247d>] ? wq_worker_sleeping+0x9/0x71 [ 0.500000] [<c130061b>] ? __schedule+0xee/0x4c8 [ 0.500000] [<c106c170>] ? call_rcu_sched+0xc/0xe [ 0.500000] [<c1031896>] ? release_task+0x37c/0x38e [ 0.500000] [<c1032aed>] ? do_exit+0x7cb/0x7e0 [ 0.500000] [<c1003f1f>] ? oops_end+0x8b/0x8f [ 0.500000] [<c1001f6f>] ? do_error_trap+0x9c/0xa7 [ 0.500000] [<c1054dbc>] ? update_sd_lb_stats+0x134/0x286 [ 0.500000] [<c100248c>] ? do_int3+0x6d/0x6d [ 0.500000] [<c100249a>] ? do_divide_error+0xe/0x11 [ 0.500000] [<c130360a>] ? error_code+0x5a/0x60 [ 0.500000] [<c100248c>] ? do_int3+0x6d/0x6d [ 0.500000] [<c1054dbc>] ? update_sd_lb_stats+0x134/0x286 [ 0.500000] [<c1054f2b>] ? find_busiest_group+0x1d/0x159 [ 0.500000] [<c105516d>] ? load_balance+0x106/0x648 [ 0.500000] [<c1051a1d>] ? sched_clock_local+0x11/0x139 [ 0.500000] [<c10558dd>] ? pick_next_task_fair+0x22e/0x31d [ 0.500000] [<c104c72e>] ? pick_next_task+0x27/0x63 [ 0.500000] [<c1300714>] ? __schedule+0x1e7/0x4c8 [ 0.500000] [<c1300907>] ? __schedule+0x3da/0x4c8 [ 0.500000] [<c1059376>] ? __wake_up_common+0x33/0x59 [ 0.500000] [<c1041f53>] ? worker_thread+0x283/0x2e1 [ 0.500000] [<c1041cd0>] ? process_scheduled_works+0x1d/0x1d [ 0.500000] [<c1045c6e>] ? kthread+0x7c/0x81 [ 0.500000] [<c1302941>] ? ret_from_kernel_thread+0x21/0x30 [ 0.500000] [<c1045bf2>] ? __kthread_parkme+0x4c/0x4c [ 0.500000] Code: 24 2c e8 62 b0 2b 00 83 c4 3c 5b 5e 5f 5d c3 64 a1 64 b6 4f c1 8b 80 68 02 00 00 8b 40 e4 c1 e8 02 83 e0 01 c3 8b 80 68 02 00 00 <8b> 40 ec c3 52 8b 90 68 02 00 00 b9 4 [ 0.500000] EIP: [<c1045fbd>] kthread_data+0x6/0xa SS:ESP 0068:f607fb50 [ 0.500000] CR2: 00000000ffffffec [ 0.500000] ---[ end trace 8420372b05e90bf6 ]--- [ 0.500000] Fixing recursive fault but reboot is needed! [ 0.500056] divide error: 0000 [#4] SMP [ 0.504000] Modules linked in: [ 0.504000] CPU: 0 PID: 1 Comm: swapper/0 Tainted: G D 3.16.0-rc4-1+ #1 [ 0.504000] Hardware name: IBM eserver xSeries 335 -[867642X]-/, BIOS -[T2E114AUS-1.03]- 11/14/2002 [ 0.504000] task: f6046a30 ti: f606c000 task.ti: f606c000 [ 0.504000] EIP: 0060:[<c1054dbc>] EFLAGS: 00010046 CPU: 0 [ 0.504000] EIP is at update_sd_lb_stats+0x134/0x286 [ 0.504000] EAX: 00000000 EBX: f606dc9c ECX: 00000000 EDX: 00000000 [ 0.504000] ESI: 00000020 EDI: ffffffff EBP: f6097e60 ESP: f606dc78 [ 0.504000] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 [ 0.504000] CR0: 8005003b CR2: ffc37000 CR3: 01508000 CR4: 000007f0 [ 0.504000] Stack: [ 0.504000] f606dd98 f606dcdc 00000000 00000000 00000000 c1501300 00000000 00000000 [ 0.504000] 00000001 00000000 00000000 00000000 00000000 00000000 ffffffff 00000000 [ 0.504000] 00000000 00000000 00000000 00000000 f606dd98 f6097ee0 f606dd48 f613c100 [ 0.504000] Call Trace: [ 0.504000] [<c1054f2b>] ? find_busiest_group+0x1d/0x159 [ 0.504000] [<c105516d>] ? load_balance+0x106/0x648 [ 0.504000] [<c1051a1d>] ? sched_clock_local+0x11/0x139 [ 0.504000] [<c10558dd>] ? pick_next_task_fair+0x22e/0x31d [ 0.504000] [<c104c72e>] ? pick_next_task+0x27/0x63 [ 0.504000] [<c1300714>] ? __schedule+0x1e7/0x4c8 [ 0.504000] [<c104cf29>] ? finish_task_switch+0x44/0x75 [ 0.504000] [<c1300907>] ? __schedule+0x3da/0x4c8 [ 0.504000] [<c1300248>] ? put_cred+0x12/0x12 [ 0.504000] [<c130025b>] ? schedule_timeout+0x13/0xcf [ 0.504000] [<c10528d5>] ? set_next_buddy+0xe/0x28 [ 0.504000] [<c10544f9>] ? check_preempt_wakeup+0xf3/0x142 [ 0.504000] [<c1300248>] ? put_cred+0x12/0x12 [ 0.504000] [<c1300248>] ? put_cred+0x12/0x12 [ 0.504000] [<c1300fd7>] ? __wait_for_common+0xcc/0xf0 [ 0.504000] [<c104fe88>] ? try_to_wake_up+0x18a/0x18a [ 0.504000] [<c1301098>] ? wait_for_completion_killable+0x14/0x23 [ 0.504000] [<c1045d06>] ? kthread_create_on_node+0x93/0x101 [ 0.504000] [<c104337f>] ? __alloc_workqueue_key+0x223/0x30b [ 0.504000] [<c1042193>] ? mod_delayed_work_on+0x45/0x45 [ 0.504000] [<c1059206>] ? init_sched_dl_class+0x2b/0x35 [ 0.504000] [<c14a6216>] ? usermodehelper_init+0x17/0x26 [ 0.504000] [<c1493aca>] ? kernel_init_freeable+0xb8/0x19a [ 0.504000] [<c12fb184>] ? kernel_init+0x5/0xb9 [ 0.504000] [<c1302941>] ? ret_from_kernel_thread+0x21/0x30 [ 0.504000] [<c12fb17f>] ? rest_init+0x5f/0x5f [ 0.504000] Code: 8d 55 10 8b 48 24 89 f0 e8 50 58 13 00 3b 05 24 d4 48 c1 89 c6 7c 95 8b 45 0c 31 d2 8b 7b 14 8b 48 04 8b 43 04 89 4b 10 c1 e0 0a <f7> f1 85 ff 89 44 24 1c 89 03 74 0a 3 [ 0.504000] EIP: [<c1054dbc>] update_sd_lb_stats+0x134/0x286 SS:ESP 0068:f606dc78 [ 0.504000] ---[ end trace 8420372b05e90bf7 ]--- [ 0.504000] divide error: 0000 [#5] SMP [ 0.504000] Modules linked in: [ 0.504000] CPU: 1 PID: 0 Comm: swapper/1 Tainted: G D 3.16.0-rc4-1+ #1 [ 0.504000] Hardware name: IBM eserver xSeries 335 -[867642X]-/, BIOS -[T2E114AUS-1.03]- 11/14/2002 [ 0.504000] task: f608c520 ti: f60aa000 task.ti: f60aa000 [ 0.504000] EIP: 0060:[<c1054dbc>] EFLAGS: 00210246 CPU: 1 [ 0.504000] EIP is at update_sd_lb_stats+0x134/0x286 [ 0.504000] EAX: 00000000 EBX: f6107e34 ECX: 00000000 EDX: 00000000 [ 0.504000] ESI: 00000020 EDI: ffffffff EBP: f6097e60 ESP: f6107e10 [ 0.504000] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 [ 0.504000] CR0: 8005003b CR2: 00000000 CR3: 01508000 CR4: 000007f0 [ 0.504000] Stack: [ 0.504000] f6107f30 f6107e74 00000000 00000001 00000000 c1501300 00000000 00000000 [ 0.504000] 00000001 00000000 00000000 00000000 00000000 00000000 ffffffff 00000000 [ 0.504000] 00000000 00000000 00000000 00000000 f6107f30 f6097ea0 f6107ee0 f613c080 [ 0.504000] Call Trace: [ 0.504000] [<c1054f2b>] ? find_busiest_group+0x1d/0x159 [ 0.504000] [<c105516d>] ? load_balance+0x106/0x648 [ 0.504000] [<c1051d7e>] ? sched_clock_cpu+0xf7/0x11b [ 0.504000] [<c1055af6>] ? rebalance_domains+0x12a/0x1d7 [ 0.504000] [<c1055bcd>] ? run_rebalance_domains+0x2a/0x10b [ 0.504000] [<c1033f62>] ? __do_softirq+0xb9/0x1ef [ 0.504000] [<c1033ea9>] ? perf_trace_irq_handler_entry+0xba/0xba [ 0.504000] [<c1003306>] ? do_softirq_own_stack+0x1a/0x1f [ 0.504000] <IRQ> [ 0.504000] [<c10341c6>] ? irq_exit+0x31/0x70 [ 0.504000] [<c1021e35>] ? smp_apic_timer_interrupt+0x22/0x2b [ 0.504000] [<c1303299>] ? apic_timer_interrupt+0x2d/0x34 [ 0.504000] [<c1008071>] ? default_idle+0x12/0x36 [ 0.504000] [<c1008515>] ? arch_cpu_idle+0x6/0x7 [ 0.504000] [<c1059a7c>] ? cpu_startup_entry+0xf3/0x1f3 [ 0.504000] Code: 8d 55 10 8b 48 24 89 f0 e8 50 58 13 00 3b 05 24 d4 48 c1 89 c6 7c 95 8b 45 0c 31 d2 8b 7b 14 8b 48 04 8b 43 04 89 4b 10 c1 e0 0a <f7> f1 85 ff 89 44 24 1c 89 03 74 0a 3 [ 0.504000] EIP: [<c1054dbc>] update_sd_lb_stats+0x134/0x286 SS:ESP 0068:f6107e10 [ 0.504000] divide error: 0000 [#6] SMP [ 0.504000] ---[ end trace 8420372b05e90bf8 ]--- [ 0.504000] Modules linked in: [ 0.504000] Kernel panic - not syncing: Fatal exception in interrupt [ 0.504000] CPU: 3 PID: 0 Comm: swapper/3 Tainted: G D 3.16.0-rc4-1+ #1 [ 0.504000] Hardware name: IBM eserver xSeries 335 -[867642X]-/, BIOS -[T2E114AUS-1.03]- 11/14/2002 [ 0.504000] task: f608fa30 ti: f60b0000 task.ti: f60b0000 [ 0.504000] EIP: 0060:[<c1054dbc>] EFLAGS: 00210246 CPU: 3 [ 0.504000] EIP is at update_sd_lb_stats+0x134/0x286 [ 0.504000] EAX: 00000000 EBX: f618fe34 ECX: 00000000 EDX: 00000000 [ 0.504000] ESI: 00000020 EDI: ffffffff EBP: f6097e60 ESP: f618fe10 [ 0.504000] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 [ 0.504000] CR0: 8005003b CR2: 00000000 CR3: 01508000 CR4: 000007f0 [ 0.504000] Stack: [ 0.504000] f618ff30 f618fe74 00000000 00000001 00000000 c1501300 00000000 00000000 [ 0.504000] 00000001 00000000 00000000 00000000 00000000 00000000 ffffffff 00000000 [ 0.504000] 00000000 00000000 00000000 00000000 f618ff30 f6097e00 f618fee0 f6150f80 [ 0.504000] Call Trace: [ 0.504000] [<c1054f2b>] ? find_busiest_group+0x1d/0x159 [ 0.504000] [<c105516d>] ? load_balance+0x106/0x648 [ 0.504000] [<c1051d7e>] ? sched_clock_cpu+0xf7/0x11b [ 0.504000] [<c1055af6>] ? rebalance_domains+0x12a/0x1d7 [ 0.504000] [<c1055bcd>] ? run_rebalance_domains+0x2a/0x10b [ 0.504000] [<c1033f62>] ? __do_softirq+0xb9/0x1ef [ 0.504000] [<c1033ea9>] ? perf_trace_irq_handler_entry+0xba/0xba [ 0.504000] [<c1003306>] ? do_softirq_own_stack+0x1a/0x1f [ 0.504000] <IRQ> [ 0.504000] [<c10341c6>] ? irq_exit+0x31/0x70 [ 0.504000] [<c1021e35>] ? smp_apic_timer_interrupt+0x22/0x2b [ 0.504000] [<c1303299>] ? apic_timer_interrupt+0x2d/0x34 [ 0.504000] [<c1008071>] ? default_idle+0x12/0x36 [ 0.504000] [<c1008515>] ? arch_cpu_idle+0x6/0x7 [ 0.504000] [<c1059a7c>] ? cpu_startup_entry+0xf3/0x1f3 [ 0.504000] Code: 8d 55 10 8b 48 24 89 f0 e8 50 58 13 00 3b 05 24 d4 48 c1 89 c6 7c 95 8b 45 0c 31 d2 8b 7b 14 8b 48 04 8b 43 04 89 4b 10 c1 e0 0a <f7> f1 85 ff 89 44 24 1c 89 03 74 0a 3 [ 0.504000] EIP: [<c1054dbc>] update_sd_lb_stats+0x134/0x286 SS:ESP 0068:f618fe10 [ 0.504000] Shutting down cpus with NMI [ 0.504000] ---[ end Kernel panic - not syncing: Fatal exception in interrupt
This was fixed in 3.16.0-rc7. http://marc.info/?l=linux-kernel&m=140552264825755