Created attachment 72714 [details] Kernel config I've encouter following problem on my system: [1418235.943959] general protection fault: 0000 [#1] SMP [1418235.944241] CPU 2 [1418235.944241] Modules linked in: it87_wdt it87 hwmon_vid netconsole k10temp [1418235.944241] [1418235.944241] Pid: 585, comm: kswapd0 Not tainted 3.2.6-Slackware #2 Gigabyte Technology Co., Ltd. GA-880GA-UD3H/GA-880GA-UD3H [1418235.944241] RIP: 0010:[<ffffffff81082848>] [<ffffffff81082848>] page_evictable+0x14/0x7b [1418235.944241] RSP: 0018:ffff880119449c10 EFLAGS: 00010206 [1418235.944241] RAX: 01ff8800d757da00 RBX: ffffea0001627580 RCX: 0000000000013b30 [1418235.944241] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffea0001627580 [1418235.944241] RBP: ffff880119449e48 R08: 0000000000000000 R09: 0000000000000002 [1418235.944241] R10: 0000000000007787 R11: 0000000000007787 R12: 0000000000000000 [1418235.944241] R13: ffffea00016275a0 R14: 0000000000000020 R15: ffffea0001627580 [1418235.944241] FS: 00007fae20518720(0000) GS:ffff88011fd00000(0000) knlGS:0000000000000000 [1418235.944241] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b [1418235.944241] CR2: 00007fe9807c5268 CR3: 0000000001805000 CR4: 00000000000006e0 [1418235.944241] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [1418235.944241] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [1418235.944241] Process kswapd0 (pid: 585, threadinfo ffff880119448000, task ffff880119440000) [1418235.944241] Stack: [1418235.944241] ffff88011fffb700 ffff880119449e48 0000000000000001 ffffffff81083651 [1418235.944241] 0000000000000001 0000000000000019 0000000000000001 ffffffff00000002 [1418235.944241] ffff880119449c70 0000000000000000 ffff88011fffbb80 0000001619440000 [1418235.944241] Call Trace: [1418235.944241] [<ffffffff81083651>] ? shrink_active_list.isra.46+0x166/0x263 [1418235.944241] [<ffffffff81083a64>] ? shrink_zone+0x316/0x45c [1418235.944241] [<ffffffff8108467f>] ? kswapd+0x491/0x71b [1418235.944241] [<ffffffff810435fe>] ? add_wait_queue+0x3c/0x3c [1418235.944241] [<ffffffff810841ee>] ? try_to_free_pages+0x418/0x418 [1418235.944241] [<ffffffff81043013>] ? kthread+0x76/0x7e [1418235.944241] [<ffffffff814c53f4>] ? kernel_thread_helper+0x4/0x10 [1418235.944241] [<ffffffff81042f9d>] ? kthread_worker_fn+0x12f/0x12f [1418235.944241] [<ffffffff814c53f0>] ? gs_change+0xb/0xb [1418235.944241] Code: fd 10 54 86 81 48 8b b8 c0 40 00 00 48 85 ff 74 05 e9 e8 07 fc ff c3 41 54 49 89 f4 55 53 48 89 fb e8 02 f3 ff ff 48 85 c0 74 0d <48> 8b 40 78 31 ed a9 00 00 00 08 75 53 48 8b 03 31 ed a9 00 00 [1418235.944241] RIP [<ffffffff81082848>] page_evictable+0x14/0x7b [1418235.944241] RSP <ffff880119449c10> [1418235.997416] ---[ end trace a2029986943439b4 ]--- After that, other errors appear. It can be caused by this above, but it can help to trace problem. 1420642.739079] general protection fault: 0000 [#2] SMP [1420642.740002] CPU 1 [1420642.740002] Modules linked in: it87_wdt it87 hwmon_vid netconsole k10temp [1420642.740002] [1420642.740002] Pid: 2068, comm: mysqld Tainted: G D 3.2.6-Slackware #2 Gigabyte Technology Co., Ltd. GA-880GA-UD3H/GA-880GA-UD3H [1420642.740002] RIP: 0010:[<ffffffff81082848>] [<ffffffff81082848>] page_evictable+0x14/0x7b [1420642.740002] RSP: 0018:ffff8800d79736c8 EFLAGS: 00010206 [1420642.740002] RAX: 01ff8800d757da00 RBX: ffffea0002387380 RCX: ffff8800d7973760 [1420642.740002] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffea0002387380 [1420642.740002] RBP: ffff8800d79738c0 R08: 0000000000000000 R09: 0000000000000002 [1420642.740002] R10: 0000000000013b30 R11: 0000000000013b30 R12: 0000000000000000 [1420642.740002] R13: ffffea00023873a0 R14: 000000000000001e R15: ffffea0002387380 [1420642.740002] FS: 00007fe9c228c700(0000) GS:ffff88011fc80000(0000) knlGS:0000000000000000 [1420642.740002] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b [1420642.740002] CR2: 00007fe980a25000 CR3: 000000011302f000 CR4: 00000000000006e0 [1420642.740002] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [1420642.740002] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [1420642.740002] Process mysqld (pid: 2068, threadinfo ffff8800d7972000, task ffff88011aeb3300) [1420642.740002] Stack: [1420642.740002] ffff88011fffb700 ffff8800d79738c0 0000000000000001 ffffffff81083651 [1420642.740002] 0000000000000001 000000000000001c 0000000000000001 ffffffff00000002 [1420642.740002] ffff8800d7973728 0000000000000000 ffff88011fffbb80 000000161aeb3300 [1420642.740002] Call Trace: [1420642.740002] [<ffffffff81083651>] ? shrink_active_list.isra.46+0x166/0x263 [1420642.740002] [<ffffffff81083a64>] ? shrink_zone+0x316/0x45c [1420642.740002] [<ffffffff81083f71>] ? try_to_free_pages+0x19b/0x418 [1420642.740002] [<ffffffff8107e327>] ? __alloc_pages_nodemask+0x4ba/0x709 [1420642.740002] [<ffffffff811613b3>] ? start_this_handle+0x435/0x44d [1420642.740002] [<ffffffff814c24ff>] ? _cond_resched+0x7/0x1c [1420642.740002] [<ffffffff810a1378>] ? alloc_pages_current+0xb2/0xcc [1420642.740002] [<ffffffff810786bf>] ? grab_cache_page_write_begin+0x4f/0xae [1420642.740002] [<ffffffff81139a59>] ? ext4_da_write_begin+0xc2/0x188 [1420642.740002] [<ffffffff8113b7a1>] ? ext4_da_write_end+0x1c0/0x201 [1420642.740002] [<ffffffff8120704d>] ? copy_user_generic_string+0x2d/0x40 [1420642.740002] [<ffffffff81078242>] ? generic_file_buffered_write+0x10f/0x259 [1420642.740002] [<ffffffff810790a2>] ? __generic_file_aio_write+0x248/0x278 [1420642.740002] [<ffffffff81032b24>] ? current_fs_time+0x31/0x37 [1420642.740002] [<ffffffff81024069>] ? should_resched+0x5/0x23 [1420642.740002] [<ffffffff8107912f>] ? generic_file_aio_write+0x5d/0xb5 [1420642.740002] [<ffffffff8113522c>] ? ext4_file_write+0x1d5/0x229 [1420642.740002] [<ffffffff810afab3>] ? do_sync_write+0xab/0xe3 [1420642.740002] [<ffffffff810511a4>] ? do_futex+0xab/0x7df [1420642.740002] [<ffffffff810d781d>] ? fsnotify+0x29/0x20c [1420642.740002] [<ffffffff811d17be>] ? selinux_file_permission+0x41/0x9b [1420642.740002] [<ffffffff811cbd37>] ? security_file_permission+0x15/0x2c [1420642.740002] [<ffffffff810b019a>] ? vfs_write+0xa2/0xe9 [1420642.740002] [<ffffffff810b0377>] ? sys_write+0x45/0x6b [1420642.740002] [<ffffffff814c3ffb>] ? system_call_fastpath+0x16/0x1b [1420642.740002] Code: fd 10 54 86 81 48 8b b8 c0 40 00 00 48 85 ff 74 05 e9 e8 07 fc ff c3 41 54 49 89 f4 55 53 48 89 fb e8 02 f3 ff ff 48 85 c0 74 0d <48> 8b 40 78 31 ed a9 00 00 00 08 75 53 48 8b 03 31 ed a9 00 00 [1420642.740002] RIP [<ffffffff81082848>] page_evictable+0x14/0x7b [1420642.740002] RSP <ffff8800d79736c8> [1420642.807992] ---[ end trace a2029986943439b5 ]--- [1420642.808011] general protection fault: 0000 [#3] SMP [1420642.808014] CPU 3 [1420642.808015] Modules linked in: it87_wdt it87 hwmon_vid netconsole k10temp [1420642.808021] [1420642.808023] Pid: 3407, comm: mysqld Tainted: G D 3.2.6-Slackware #2 Gigabyte Technology Co., Ltd. GA-880GA-UD3H/GA-880GA-UD3H [1420642.808028] RIP: 0010:[<ffffffff81082848>] [<ffffffff81082848>] page_evictable+0x14/0x7b [1420642.808035] RSP: 0018:ffff88008c38f6c8 EFLAGS: 00010206 [1420642.808038] RAX: 01ff8800d757da00 RBX: ffffea00022cfbc0 RCX: ffff88008c38f760 [1420642.808040] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffea00022cfbc0 [1420642.808042] RBP: ffff88008c38f8c0 R08: 0000000000000000 R09: 0000000000000002 [1420642.808045] R10: ffffea0002530000 R11: ffffea0002530000 R12: 0000000000000000 [1420642.808047] R13: ffffea00022cfbe0 R14: 0000000000000020 R15: ffffea00022cfbc0 [1420642.808049] FS: 00007fe9866e7700(0000) GS:ffff88011fd80000(0000) knlGS:0000000000000000 [1420642.808052] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b [1420642.808054] CR2: 00007f8e046d1000 CR3: 000000011302f000 CR4: 00000000000006e0 [1420642.808056] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [1420642.808059] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [1420642.808061] Process mysqld (pid: 3407, threadinfo ffff88008c38e000, task ffff88011aeb2ca0) [1420642.808063] Stack: [1420642.808064] ffff88011fffb700 ffff88008c38f8c0 0000000000000001 ffffffff81083651 [1420642.808068] 0000000000000001 0000000000000020 0000000000000001 ffffffff00000002 [1420642.808072] ffff88008c38f728 0000000000000000 ffff88011fffbb80 000000161aeb2ca0 [1420642.808076] Call Trace: [1420642.808079] [<ffffffff81083651>] ? shrink_active_list.isra.46+0x166/0x263 [1420642.808082] [<ffffffff81083a64>] ? shrink_zone+0x316/0x45c [1420642.808086] [<ffffffff81083f71>] ? try_to_free_pages+0x19b/0x418 [1420642.808090] [<ffffffff8107e327>] ? __alloc_pages_nodemask+0x4ba/0x709 [1420642.808095] [<ffffffff811613b3>] ? start_this_handle+0x435/0x44d [1420642.808099] [<ffffffff814c24ff>] ? _cond_resched+0x7/0x1c [1420642.808103] [<ffffffff810a1378>] ? alloc_pages_current+0xb2/0xcc [1420642.808106] [<ffffffff810786bf>] ? grab_cache_page_write_begin+0x4f/0xae [1420642.808110] [<ffffffff81139a59>] ? ext4_da_write_begin+0xc2/0x188 [1420642.808113] [<ffffffff8113b7a1>] ? ext4_da_write_end+0x1c0/0x201 [1420642.808117] [<ffffffff8120704d>] ? copy_user_generic_string+0x2d/0x40 [1420642.808121] [<ffffffff81078242>] ? generic_file_buffered_write+0x10f/0x259 [1420642.808125] [<ffffffff810790a2>] ? __generic_file_aio_write+0x248/0x278 [1420642.808129] [<ffffffff81032b24>] ? current_fs_time+0x31/0x37 [1420642.808133] [<ffffffff81024069>] ? should_resched+0x5/0x23 [1420642.808135] [<ffffffff8107912f>] ? generic_file_aio_write+0x5d/0xb5 [1420642.808139] [<ffffffff8113522c>] ? ext4_file_write+0x1d5/0x229 [1420642.808142] [<ffffffff810afab3>] ? do_sync_write+0xab/0xe3 [1420642.808146] [<ffffffff810511a4>] ? do_futex+0xab/0x7df [1420642.808150] [<ffffffff810d782f>] ? fsnotify+0x3b/0x20c [1420642.808153] [<ffffffff811d17be>] ? selinux_file_permission+0x41/0x9b [1420642.808157] [<ffffffff811cbd37>] ? security_file_permission+0x15/0x2c [1420642.808160] [<ffffffff810b019a>] ? vfs_write+0xa2/0xe9 [1420642.808163] [<ffffffff810b0377>] ? sys_write+0x45/0x6b [1420642.808166] [<ffffffff814c3ffb>] ? system_call_fastpath+0x16/0x1b [1420642.808168] Code: fd 10 54 86 81 48 8b b8 c0 40 00 00 48 85 ff 74 05 e9 e8 07 fc ff c3 41 54 49 89 f4 55 53 48 89 fb e8 02 f3 ff ff 48 85 c0 74 0d <48> 8b 40 78 31 ed a9 00 00 00 08 75 53 48 8b 03 31 ed a9 00 00 [1420642.808201] RIP [<ffffffff81082848>] page_evictable+0x14/0x7b [1420642.808204] RSP <ffff88008c38f6c8> [1420642.808207] ---[ end trace a2029986943439b6 ]--- [1420642.869762] ------------[ cut here ]------------ [1420642.870905] WARNING: at kernel/exit.c:898 do_exit+0x57/0x774() [1420642.872053] Hardware name: GA-880GA-UD3H [1420642.873186] Modules linked in: it87_wdt it87 hwmon_vid netconsole k10temp [1420642.874333] Pid: 2068, comm: mysqld Tainted: G D 3.2.6-Slackware #2 [1420642.875449] Call Trace: [1420642.876532] [<ffffffff8102ebf1>] ? warn_slowpath_common+0x78/0x8c [1420642.877632] [<ffffffff81031656>] ? do_exit+0x57/0x774 [1420642.878717] [<ffffffff81030088>] ? kmsg_dump+0x40/0xcc [1420642.879798] [<ffffffff81004aa9>] ? oops_end+0xa8/0xad [1420642.880871] [<ffffffff814c3bbf>] ? general_protection+0x1f/0x30 [1420642.881955] [<ffffffff81082848>] ? page_evictable+0x14/0x7b [1420642.883031] [<ffffffff81082843>] ? page_evictable+0xf/0x7b [1420642.884080] [<ffffffff81083651>] ? shrink_active_list.isra.46+0x166/0x263 [1420642.885129] [<ffffffff81083a64>] ? shrink_zone+0x316/0x45c [1420642.886163] [<ffffffff81083f71>] ? try_to_free_pages+0x19b/0x418 [1420642.887203] [<ffffffff8107e327>] ? __alloc_pages_nodemask+0x4ba/0x709 [1420642.888256] [<ffffffff811613b3>] ? start_this_handle+0x435/0x44d [1420642.889294] [<ffffffff814c24ff>] ? _cond_resched+0x7/0x1c [1420642.890315] [<ffffffff810a1378>] ? alloc_pages_current+0xb2/0xcc [1420642.891327] [<ffffffff810786bf>] ? grab_cache_page_write_begin+0x4f/0xae [1420642.892346] [<ffffffff81139a59>] ? ext4_da_write_begin+0xc2/0x188 [1420642.893361] [<ffffffff8113b7a1>] ? ext4_da_write_end+0x1c0/0x201 [1420642.894358] [<ffffffff8120704d>] ? copy_user_generic_string+0x2d/0x40 [1420642.895350] [<ffffffff81078242>] ? generic_file_buffered_write+0x10f/0x259 [1420642.896348] [<ffffffff810790a2>] ? __generic_file_aio_write+0x248/0x278 [1420642.897349] [<ffffffff81032b24>] ? current_fs_time+0x31/0x37 [1420642.898348] [<ffffffff81024069>] ? should_resched+0x5/0x23 [1420642.899343] [<ffffffff8107912f>] ? generic_file_aio_write+0x5d/0xb5 [1420642.900343] [<ffffffff8113522c>] ? ext4_file_write+0x1d5/0x229 [1420642.901342] [<ffffffff810afab3>] ? do_sync_write+0xab/0xe3 [1420642.902338] [<ffffffff810511a4>] ? do_futex+0xab/0x7df [1420642.903324] [<ffffffff810d781d>] ? fsnotify+0x29/0x20c [1420642.904313] [<ffffffff811d17be>] ? selinux_file_permission+0x41/0x9b [1420642.905306] [<ffffffff811cbd37>] ? security_file_permission+0x15/0x2c [1420642.906297] [<ffffffff810b019a>] ? vfs_write+0xa2/0xe9 [1420642.907283] [<ffffffff810b0377>] ? sys_write+0x45/0x6b [1420642.908258] [<ffffffff814c3ffb>] ? system_call_fastpath+0x16/0x1b [1420642.909239] ---[ end trace a2029986943439b7 ]--- [1420645.839556] stack segment: 0000 [#4] SMP [1420645.840002] CPU 0 [1420645.840002] Modules linked in: it87_wdt it87 hwmon_vid netconsole k10temp [1420645.840002] [1420645.840002] Pid: 1319, comm: mysqld Tainted: G D W 3.2.6-Slackware #2 Gigabyte Technology Co., Ltd. GA-880GA-UD3H/GA-880GA-UD3H [1420645.840002] RIP: 0010:[<ffffffff810968c3>] [<ffffffff810968c3>] page_lock_anon_vma+0x27/0xb1 [1420645.840002] RSP: 0018:ffff88008c2035d8 EFLAGS: 00010246 [1420645.840002] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffff88008c203710 [1420645.840002] RDX: 0000000000000001 RSI: 0000000000000000 RDI: ffffea0002686d40 [1420645.840002] RBP: 01ff8801132ecea1 R08: 0000000000000000 R09: ffff880113281440 [1420645.840002] R10: ffffea0002687400 R11: ffffea0002687400 R12: ffffea0002686d40 [1420645.840002] R13: ffffea0002686d60 R14: ffff88008c203710 R15: 0000000000000000 [1420645.840002] FS: 00007fe986561700(0000) GS:ffff88011fc00000(0000) knlGS:0000000000000000 [1420645.840002] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [1420645.840002] CR2: 00007fe9811aad9f CR3: 000000011302f000 CR4: 00000000000006f0 [1420645.840002] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [1420645.840002] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [1420645.840002] Process mysqld (pid: 1319, threadinfo ffff88008c202000, task ffff880119442640) [1420645.840002] Stack: [1420645.840002] ffffea0002687400 ffffea0002686d40 0000000000000000 0000000000000000 [1420645.840002] ffffea0002686d60 ffffffff81096b42 ffff88011997b370 ffff8801132eced0 [1420645.840002] 0000000000000020 ffff88008c2036d8 00000000018ab900 ffffffffffffffff [1420645.840002] Call Trace: [1420645.840002] [<ffffffff81096b42>] ? page_referenced+0x9d/0x1eb [1420645.840002] [<ffffffff81083672>] ? shrink_active_list.isra.46+0x187/0x263 [1420645.840002] [<ffffffff81083ba5>] ? shrink_zone+0x457/0x45c [1420645.840002] [<ffffffff81083f71>] ? try_to_free_pages+0x19b/0x418 [1420645.840002] [<ffffffff8107d14e>] ? free_pcppages_bulk+0xbd/0xcf [1420645.840002] [<ffffffff8107e327>] ? __alloc_pages_nodemask+0x4ba/0x709 [1420645.840002] [<ffffffff810a26a9>] ? alloc_pages_vma+0xe2/0xe7 [1420645.840002] [<ffffffff8108e547>] ? handle_pte_fault+0x162/0x6b7 [1420645.840002] [<ffffffff813da43d>] ? memcpy_toiovec+0x38/0x66 [1420645.840002] [<ffffffff81037b66>] ? lock_timer_base.isra.24+0x23/0x47 [1420645.840002] [<ffffffff8101c712>] ? do_page_fault+0x29c/0x2c2 [1420645.840002] [<ffffffff81088b1a>] ? __inc_zone_state+0x41/0x49 [1420645.840002] [<ffffffff81088d25>] ? zone_statistics+0x41/0x74 [1420645.840002] [<ffffffff8107dc26>] ? get_page_from_freelist+0x565/0x64b [1420645.840002] [<ffffffff814bdc00>] ? __slab_free+0xd6/0x206 [1420645.840002] [<ffffffff814c3bef>] ? page_fault+0x1f/0x30 [1420645.840002] [<ffffffff810789a5>] ? file_read_actor+0x48/0x10a [1420645.840002] [<ffffffff810789f1>] ? file_read_actor+0x94/0x10a [1420645.840002] [<ffffffff81079539>] ? generic_file_aio_read+0x3b2/0x5cf [1420645.840002] [<ffffffff810a2683>] ? alloc_pages_vma+0xbc/0xe7 [1420645.840002] [<ffffffff81082843>] ? page_evictable+0xf/0x7b [1420645.840002] [<ffffffff81080d9e>] ? __lru_cache_add+0x2b/0x57 [1420645.840002] [<ffffffff810afb96>] ? do_sync_read+0xab/0xe3 [1420645.840002] [<ffffffff810b0280>] ? vfs_read+0x9f/0xe6 [1420645.840002] [<ffffffff810b030c>] ? sys_read+0x45/0x6b [1420645.840002] [<ffffffff814c3ffb>] ? system_call_fastpath+0x16/0x1b [1420645.840002] Code: 5d 41 5e c3 41 55 41 54 49 89 fc 55 53 31 db 41 52 48 8b 6f 08 48 89 e8 83 e0 03 48 ff c8 0f 85 85 00 00 00 8b 47 18 85 c0 78 7e <4c> 8b 6d ff 48 8d 5d ff 49 83 c5 08 4c 89 ef e8 53 c3 42 00 85 [1420645.840002] RIP [<ffffffff810968c3>] page_lock_anon_vma+0x27/0xb1 [1420645.840002] RSP <ffff88008c2035d8> [1420645.896306] ---[ end trace a2029986943439b8 ]--- [1420645.897380] note: mysqld[1319] exited with preempt_count 1 [1420645.898448] BUG: scheduling while atomic: mysqld/1319/0x10000001 [1420645.899518] Modules linked in: it87_wdt it87 hwmon_vid netconsole k10temp [1420645.900597] Pid: 1319, comm: mysqld Tainted: G D W 3.2.6-Slackware #2 [1420645.901646] Call Trace: [1420645.902651] <#SS> [<ffffffff814c1f5c>] ? __schedule+0x85/0x5e4 [1420645.903675] [<ffffffff8102a723>] ? __cond_resched+0x1d/0x26 [1420645.904692] [<ffffffff814c250a>] ? _cond_resched+0x12/0x1c [1420645.905719] [<ffffffff81050feb>] ? exit_robust_list+0x2a/0x138 [1420645.906744] [<ffffffff8102cc69>] ? mm_release+0x20/0xde [1420645.907762] [<ffffffff8103029c>] ? exit_mm+0x1c/0x119 [1420645.908783] [<ffffffff8106fad3>] ? taskstats_exit+0x2/0x2db [1420645.909798] [<ffffffff81031838>] ? do_exit+0x239/0x774 [1420645.910791] [<ffffffff81031601>] ? do_exit+0x2/0x774 [1420645.911775] [<ffffffff81004aa9>] ? oops_end+0xa8/0xad [1420645.912753] [<ffffffff81002b40>] ? do_stack_segment+0x5e/0x71 [1420645.913743] [<ffffffff814c3b8f>] ? stack_segment+0x1f/0x30 [1420645.914721] [<ffffffff810968c3>] ? page_lock_anon_vma+0x27/0xb1 [1420645.915679] <<EOE>> [<ffffffff81096b42>] ? page_referenced+0x9d/0x1eb [1420645.916642] [<ffffffff81083672>] ? shrink_active_list.isra.46+0x187/0x263 [1420645.917611] [<ffffffff81083ba5>] ? shrink_zone+0x457/0x45c [1420645.918567] [<ffffffff81083f71>] ? try_to_free_pages+0x19b/0x418 [1420645.919514] [<ffffffff8107d14e>] ? free_pcppages_bulk+0xbd/0xcf [1420645.920455] [<ffffffff8107e327>] ? __alloc_pages_nodemask+0x4ba/0x709 [1420645.921400] [<ffffffff810a26a9>] ? alloc_pages_vma+0xe2/0xe7 [1420645.922340] [<ffffffff8108e547>] ? handle_pte_fault+0x162/0x6b7 [1420645.923286] [<ffffffff813da43d>] ? memcpy_toiovec+0x38/0x66 [1420645.924233] [<ffffffff81037b66>] ? lock_timer_base.isra.24+0x23/0x47 [1420645.925187] [<ffffffff8101c712>] ? do_page_fault+0x29c/0x2c2 [1420645.926140] [<ffffffff81088b1a>] ? __inc_zone_state+0x41/0x49 [1420645.927093] [<ffffffff81088d25>] ? zone_statistics+0x41/0x74 [1420645.928044] [<ffffffff8107dc26>] ? get_page_from_freelist+0x565/0x64b [1420645.928997] [<ffffffff814bdc00>] ? __slab_free+0xd6/0x206 [1420645.929953] [<ffffffff814c3bef>] ? page_fault+0x1f/0x30 [1420645.930906] [<ffffffff810789a5>] ? file_read_actor+0x48/0x10a [1420645.931864] [<ffffffff810789f1>] ? file_read_actor+0x94/0x10a [1420645.932810] [<ffffffff81079539>] ? generic_file_aio_read+0x3b2/0x5cf [1420645.933764] [<ffffffff810a2683>] ? alloc_pages_vma+0xbc/0xe7 [1420645.934716] [<ffffffff81082843>] ? page_evictable+0xf/0x7b [1420645.935669] [<ffffffff81080d9e>] ? __lru_cache_add+0x2b/0x57 [1420645.936634] [<ffffffff810afb96>] ? do_sync_read+0xab/0xe3 [1420645.937597] [<ffffffff810b0280>] ? vfs_read+0x9f/0xe6 [1420645.938556] [<ffffffff810b030c>] ? sys_read+0x45/0x6b [1420645.939508] [<ffffffff814c3ffb>] ? system_call_fastpath+0x16/0x1b [1420743.290410] general protection fault: 0000 [#5] SMP [1420743.291033] CPU 1 [1420743.291033] Modules linked in: it87_wdt it87 hwmon_vid netconsole k10temp [1420743.291033] [1420743.291033] Pid: 653, comm: khugepaged Tainted: G D W 3.2.6-Slackware #2 Gigabyte Technology Co., Ltd. GA-880GA-UD3H/GA-880GA-UD3H [1420743.291033] RIP: 0010:[<ffffffff81082848>] [<ffffffff81082848>] page_evictable+0x14/0x7b [1420743.291033] RSP: 0018:ffff88011951f9c0 EFLAGS: 00010206 [1420743.291033] RAX: 01ff8800d757da00 RBX: ffffea00022ef4c0 RCX: ffff88011951fa58 [1420743.291033] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffea00022ef4c0 [1420743.291033] RBP: ffff88011951fbb8 R08: 0000000000000001 R09: 0000000000000002 [1420743.291033] R10: ffffea0003468040 R11: ffffea0003468040 R12: 0000000000000000 [1420743.291033] R13: ffffea00022ef4e0 R14: 0000000000000021 R15: ffffea00022ef4c0 [1420743.291033] FS: 00007f8e046b7720(0000) GS:ffff88011fc80000(0000) knlGS:0000000000000000 [1420743.291033] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b [1420743.291033] CR2: 00007f8e046d1000 CR3: 00000001131df000 CR4: 00000000000006e0 [1420743.291033] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [1420743.291033] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [1420743.291033] Process khugepaged (pid: 653, threadinfo ffff88011951e000, task ffff880119440cc0) [1420743.291033] Stack: [1420743.291033] ffff88011fffb700 ffff88011951fbb8 0000000000000001 ffffffff81083651 [1420743.291033] 0000000000000001 000000000000001c 0000000000000001 ffffffff00000002 [1420743.291033] ffff88011951fa20 0000000000000000 ffff88011fffbb80 0000001619440cc0 [1420743.291033] Call Trace: [1420743.291033] [<ffffffff81083651>] ? shrink_active_list.isra.46+0x166/0x263 [1420743.291033] [<ffffffff81083a64>] ? shrink_zone+0x316/0x45c [1420743.291033] [<ffffffff81083f71>] ? try_to_free_pages+0x19b/0x418 [1420743.291033] [<ffffffff8107e327>] ? __alloc_pages_nodemask+0x4ba/0x709 [1420743.291033] [<ffffffff810a26a9>] ? alloc_pages_vma+0xe2/0xe7 [1420743.291033] [<ffffffff810ac3ac>] ? khugepaged+0x4c3/0xdc8 [1420743.291033] [<ffffffff810435fe>] ? add_wait_queue+0x3c/0x3c [1420743.291033] [<ffffffff810abee9>] ? add_mm_counter.constprop.43+0x9/0x9 [1420743.291033] [<ffffffff81043013>] ? kthread+0x76/0x7e [1420743.291033] [<ffffffff814c53f4>] ? kernel_thread_helper+0x4/0x10 [1420743.291033] [<ffffffff81042f9d>] ? kthread_worker_fn+0x12f/0x12f [1420743.291033] [<ffffffff814c53f0>] ? gs_change+0xb/0xb [1420743.291033] Code: fd 10 54 86 81 48 8b b8 c0 40 00 00 48 85 ff 74 05 e9 e8 07 fc ff c3 41 54 49 89 f4 55 53 48 89 fb e8 02 f3 ff ff 48 85 c0 74 0d <48> 8b 40 78 31 ed a9 00 00 00 08 75 53 48 8b 03 31 ed a9 00 00 [1420743.291033] RIP [<ffffffff81082848>] page_evictable+0x14/0x7b [1420743.291033] RSP <ffff88011951f9c0> [1420743.332259] ---[ end trace a2029986943439b9 ]--- Next error did'nt log on original system, I've it only by netconsole: [1423300.177785] general protection fault: 0000 [#6] SMP [1423300.178001] CPU 3 [1423300.178001] Modules linked in: it87_wdt it87 hwmon_vid netconsole k10temp [1423300.178001] [1423300.178001] Pid: 2073, comm: freshclam Tainted: G D W 3.2.6-Slackware #2 Gigabyte Technology Co., Ltd. GA-880GA-UD3H/GA-880GA-UD3H [1423300.178001] RIP: 0010:[<ffffffff81082848>] [<ffffffff81082848>] page_evictable+0x14/0x7b [1423300.178001] RSP: 0018:ffff880113a6b6c8 EFLAGS: 00010206 [1423300.178001] RAX: 01ff8800d757da00 RBX: ffffea00022cc340 RCX: ffff880113a6b760 [1423300.178001] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffea00022cc340 [1423300.178001] RBP: ffff880113a6b8c0 R08: 0000000000000000 R09: 0000000000000002 [1423300.178001] R10: ffffea00044171c0 R11: ffffea00044171c0 R12: 0000000000000000 [1423300.178001] R13: ffffea00022cc360 R14: 0000000000000020 R15: ffffea00022cc340 [1423300.178001] FS: 00007f36ccd9c740(0000) GS:ffff88011fd80000(0000) knlGS:0000000000000000 [1423300.178001] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [1423300.178001] CR2: 00007f36ccdb7000 CR3: 000000011a866000 CR4: 00000000000006e0 [1423300.178001] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [1423300.178001] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [1423300.178001] Process freshclam (pid: 2073, threadinfo ffff880113a6a000, task ffff88011a958cc0) [1423300.178001] Stack: [1423300.178001] ffff88011fffb700 ffff880113a6b8c0 0000000000000001 ffffffff81083651 [1423300.178001] 0000000000000001 0000000000000020 0000000000000001 ffffffff00000002 [1423300.178001] ffff880113a6b728 0000000000000000 ffff88011fffbb80 000000161a958cc0 [1423300.178001] Call Trace: [1423300.178001] [<ffffffff81083651>] ? shrink_active_list.isra.46+0x166/0x263 [1423300.178001] [<ffffffff81083a64>] ? shrink_zone+0x316/0x45c [1423300.178001] [<ffffffff81083f71>] ? try_to_free_pages+0x19b/0x418 [1423300.178001] [<ffffffff8107e327>] ? __alloc_pages_nodemask+0x4ba/0x709 [1423300.178001] [<ffffffff811613b3>] ? start_this_handle+0x435/0x44d [1423300.178001] [<ffffffff814c24ff>] ? _cond_resched+0x7/0x1c [1423300.178001] [<ffffffff810a1378>] ? alloc_pages_current+0xb2/0xcc [1423300.178001] [<ffffffff810786bf>] ? grab_cache_page_write_begin+0x4f/0xae [1423300.178001] [<ffffffff81139a59>] ? ext4_da_write_begin+0xc2/0x188 [1423300.178001] [<ffffffff8113b7a1>] ? ext4_da_write_end+0x1c0/0x201 [1423300.178001] [<ffffffff81024bcd>] ? __wake_up+0x35/0x46 [1423300.178001] [<ffffffff81078242>] ? generic_file_buffered_write+0x10f/0x259 [1423300.178001] [<ffffffff810790a2>] ? __generic_file_aio_write+0x248/0x278 [1423300.178001] [<ffffffff81032b24>] ? current_fs_time+0x31/0x37 [1423300.178001] [<ffffffff81024069>] ? should_resched+0x5/0x23 [1423300.178001] [<ffffffff8107912f>] ? generic_file_aio_write+0x5d/0xb5 [1423300.178001] [<ffffffff8113522c>] ? ext4_file_write+0x1d5/0x229 [1423300.178001] [<ffffffff81080d9e>] ? __lru_cache_add+0x2b/0x57 [1423300.178001] [<ffffffff810afab3>] ? do_sync_write+0xab/0xe3 [1423300.178001] [<ffffffff811d17be>] ? selinux_file_permission+0x41/0x9b [1423300.178001] [<ffffffff811cbd37>] ? security_file_permission+0x15/0x2c [1423300.178001] [<ffffffff810b019a>] ? vfs_write+0xa2/0xe9 [1423300.178001] [<ffffffff810b0377>] ? sys_write+0x45/0x6b [1423300.178001] [<ffffffff814c3ffb>] ? system_call_fastpath+0x16/0x1b [1423300.178001] Code: fd 10 54 86 81 48 8b b8 c0 40 00 00 48 85 ff 74 05 e9 e8 07 fc ff c3 41 54 49 89 f4 55 53 48 89 fb e8 02 f3 ff ff 48 85 c0 74 0d <48> 8b 40 78 31 ed a9 00 00 00 08 75 53 48 8b 03 31 ed a9 00 00 [1423300.178001] RIP [<ffffffff81082848>] page_evictable+0x14/0x7b [1423300.178001] RSP <ffff880113a6b6c8> [1423300.245255] ---[ end trace a2029986943439ba ]--- In this stage, I cannot login to system. However it responds to ping and it cannot be connected to ssh socket (returns write error after some time). Also, I was able to do "near clean" reboot by magic sys key. I've seen this error first time, and have no idea how to reproduce it. Sysinfo: Linux new-db 3.2.6-Slackware #2 SMP Wed Feb 15 09:34:22 CET 2012 x86_64 AMD Phenom(tm) II X4 955 Processor AuthenticAMD GNU/Linux Gnu C 4.6.2 Gnu make 3.82 binutils 2.21.53.0.2.20110804 util-linux 2.19 mount support module-init-tools 3.12 e2fsprogs 1.41.14 jfsutils 1.1.15 reiserfsprogs 3.6.21 pcmciautils 017 PPP 2.4.5 Linux C Library 2.14.1 Dynamic linker (ldd) 2.14.1 Procps 3.2.8 Net-tools 1.60 Kbd 1.15.2 oprofile 0.9.6 Sh-utils 8.15 Modules Loaded it87_wdt it87 hwmon_vid netconsole k10temp
Again, same hardware, same type of error but different place. I've deiced to paste it here, because if this is same kernel issue - it is justified or if I have some kind of hardware error - I didn;t start new spammy report. Here is log (netconsole only): [851916.584963] general protection fault: 0000 [#1] SMP [851916.585002] CPU 2 [851916.585002] Modules linked in: it87_wdt it87 hwmon_vid netconsole k10temp [851916.585002] [851916.585002] Pid: 0, comm: swapper/2 Not tainted 3.2.6-Slackware #2 Gigabyte Technology Co., Ltd. GA-880GA-UD3H/GA-880GA-UD3H [851916.590675] RIP: 0010:[<ffffffff812032d2>] [<ffffffff812032d2>] rb_next+0x2b/0x3f [851916.590675] RSP: 0018:ffff88011ae99e00 EFLAGS: 00010002 [851916.590675] RAX: 00ff880114b1ac70 RBX: ffff88011fd0d150 RCX: 0000000000000001 [851916.590675] RDX: 00ff880114b1ac70 RSI: ffff88011fd0d150 RDI: ffff88011fd0d150 [851916.590675] RBP: ffff88011fd0d090 R08: 0000000000000001 R09: 0000000100ce2fff [851916.590675] R10: 0000000100ce2fff R11: ffff88011fd0d150 R12: 0000000000000000 [851916.590675] R13: 0000000000000001 R14: ffff88011fd0d150 R15: 0000000132c2a348 [851916.590675] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b [851916.590675] CR2: 00007f46402ce000 CR3: 0000000117b7c000 CR4: 00000000000006e0 [851916.590675] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [851916.590675] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [851916.590675] Process swapper/2 (pid: 0, threadinfo ffff88011ae98000, task ffff88011ae5d940) [851916.590675] Stack: [851916.590675] ffffffff81204f81 0000000000000000 ffff88011fd0d080 ffff88011fd0d150 [851916.590675] ffffffff81045b7f ffff88011fd0d150 000306d04e22ce00 0000000000000002 [851916.590675] ffff88011fd0d080 0000000000000001 ffffffff81045eeb 0000000000000282 [851916.590675] Call Trace: [851916.590675] [<ffffffff81204f81>] ? timerqueue_del+0x44/0x63 [851916.590675] [<ffffffff81045b7f>] ? __remove_hrtimer+0x2a/0x82 [851916.590675] [<ffffffff81045eeb>] ? __hrtimer_start_range_ns+0x68/0x269 [851916.590675] [<ffffffff81038067>] ? get_next_timer_interrupt+0x18d/0x203 [851916.590675] [<ffffffff810077dc>] ? read_tsc+0x5/0x14 [851916.590675] [<ffffffff8104edf6>] ? tick_nohz_stop_sched_tick+0x28a/0x30a [851916.590675] [<ffffffff810011bf>] ? cpu_idle+0x24/0x94 [851916.590675] Code: 48 8b 17 31 c0 48 83 e2 fc 48 39 d7 74 30 48 8b 47 08 48 85 c0 75 1e eb 03 48 89 d7 48 8b 17 48 83 e2 fc 48 85 d2 48 89 d0 74 13 <48> 3b 7a 08 74 e8 c3 48 89 d0 48 8b 50 10 48 85 d2 75 f4 c3 48 [851916.590675] RIP [<ffffffff812032d2>] rb_next+0x2b/0x3f [851916.590675] RSP <ffff88011ae99e00> [851916.590675] ---[ end trace 7d588ba069679eb9 ]--- [851916.590675] Kernel panic - not syncing: Attempted to kill the idle task! [851916.590675] Pid: 0, comm: swapper/2 Tainted: G D 3.2.6-Slackware #2 [851916.590675] Call Trace: [851916.590675] [<ffffffff814bb96b>] ? panic+0x95/0x195 [851916.590675] [<ffffffff8103168c>] ? do_exit+0x8d/0x774 [851916.590675] [<ffffffff81030088>] ? kmsg_dump+0x40/0xcc [851916.590675] [<ffffffff81004aa9>] ? oops_end+0xa8/0xad [851916.590675] [<ffffffff814c3bbf>] ? general_protection+0x1f/0x30 [851916.645057] general protection fault: 0000 [#2] SMP [851916.645059] CPU 0 [851916.645060] Modules linked in: it87_wdt it87 hwmon_vid netconsole k10temp [851916.645063] [851916.645065] Pid: 0, comm: swapper/0 Tainted: G D 3.2.6-Slackware #2 Gigabyte Technology Co., Ltd. GA-880GA-UD3H/GA-880GA-UD3H [851916.645068] RIP: 0010:[<ffffffff8102a1b9>] [<ffffffff8102a1b9>] load_balance+0x2d5/0x5f8 [851916.645073] RSP: 0018:ffff88011fc03d80 EFLAGS: 00010007 [851916.645075] RAX: 00ff88011fd90938 RBX: 00ff88011fd908b0 RCX: ffffffff81946c80 [851916.645076] RDX: ffffffff81946ce8 RSI: 0000000000000018 RDI: 0000000000000003 [851916.645077] RBP: ffff88011fc0cc48 R08: ffffffff81946ce8 R09: 0000000000000000 [851916.645079] R10: 0000000000000c03 R11: 0000000000000000 R12: ffff88011fd90840 [851916.645080] R13: ffff88011fd90840 R14: ffff88011ae44d80 R15: 0000000000000000 [851916.645082] FS: 00007f46a0385700(0000) GS:ffff88011fc00000(0000) knlGS:0000000000000000 [851916.645083] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b [851916.645085] CR2: 00007f4660847000 CR3: 0000000001805000 CR4: 00000000000006f0 [851916.645086] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [851916.645087] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [851916.645089] Process swapper/0 (pid: 0, threadinfo ffffffff81800000, task ffffffff8180d020) [851916.645090] Stack: [851916.645091] 0000000000000000 0000000000000400 ffff88011b404798 ffff88011fc10840 [851916.645093] 0000000000010840 0000000100000100 ffffea000062e180 000000001af19b00 [851916.645095] 0000000000000202 0000000000000400 0000000000000400 ffffffff814bdc00 [851916.645096] Call Trace: [851916.645097] <IRQ> [851916.645100] [<ffffffff814bdc00>] ? __slab_free+0xd6/0x206 [851916.645103] [<ffffffff81048f70>] ? ktime_get+0x50/0x86 [851916.645105] [<ffffffff8102a5b8>] ? rebalance_domains+0xdc/0x14a [851916.645107] [<ffffffff8102a661>] ? run_rebalance_domains+0x3b/0xe0 [851916.645110] [<ffffffff81033340>] ? __do_softirq+0x7f/0x104 [851916.645113] [<ffffffff814c54ec>] ? call_softirq+0x1c/0x30 [851916.645115] [<ffffffff81003959>] ? do_softirq+0x2e/0x61 [851916.645117] [<ffffffff81033568>] ? irq_exit+0x3d/0x9d [851916.645119] [<ffffffff81015709>] ? smp_apic_timer_interrupt+0x73/0x80 [851916.645121] [<ffffffff814c4a8b>] ? apic_timer_interrupt+0x6b/0x70 [851916.645122] <EOI> [851916.645125] [<ffffffff810084f6>] ? default_idle+0x1e/0x32 [851916.645127] [<ffffffff810086be>] ? amd_e400_idle+0xb7/0xd4 [851916.645129] [<ffffffff810011f5>] ? cpu_idle+0x5a/0x94 [851916.645131] [<ffffffff81881a5e>] ? start_kernel+0x326/0x331 [851916.645132] Code: 85 d2 75 c3 49 8b 84 24 f8 07 00 00 4d 89 e5 48 89 84 24 a8 00 00 00 48 8b 9c 24 a8 00 00 00 48 81 eb 88 00 00 00 e9 46 01 00 00 <48> 83 bb a0 00 00 00 00 48 8b 83 a8 00 00 00 48 8b 13 48 89 44 [851916.645144] RIP [<ffffffff8102a1b9>] load_balance+0x2d5/0x5f8 [851916.645146] RSP <ffff88011fc03d80> [851916.645148] ---[ end trace 7d588ba069679eba ]--- [851916.645149] Kernel panic - not syncing: Fatal exception in interrupt [851916.645151] Pid: 0, comm: swapper/0 Tainted: G D 3.2.6-Slackware #2 [851916.645152] Call Trace: [851916.645152] <IRQ> [<ffffffff814bb96b>] ? panic+0x95/0x195 [851916.645155] [<ffffffff81004aa1>] ? oops_end+0xa0/0xad [851916.645157] [<ffffffff814c3bbf>] ? general_protection+0x1f/0x30 [851916.645159] [<ffffffff8102a1b9>] ? load_balance+0x2d5/0x5f8 [851916.645161] [<ffffffff814bdc00>] ? __slab_free+0xd6/0x206 [851916.645163] [<ffffffff81048f70>] ? ktime_get+0x50/0x86 [851916.645165] [<ffffffff8102a5b8>] ? rebalance_domains+0xdc/0x14a [851916.645167] [<ffffffff8102a661>] ? run_rebalance_domains+0x3b/0xe0 [851916.645169] [<ffffffff81033340>] ? __do_softirq+0x7f/0x104 [851916.645171] [<ffffffff814c54ec>] ? call_softirq+0x1c/0x30 [851916.645172] [<ffffffff81003959>] ? do_softirq+0x2e/0x61 [851916.645174] [<ffffffff81033568>] ? irq_exit+0x3d/0x9d [851916.645176] [<ffffffff81015709>] ? smp_apic_timer_interrupt+0x73/0x80 [851916.645178] [<ffffffff814c4a8b>] ? apic_timer_interrupt+0x6b/0x70 [851916.645179] <EOI> [<ffffffff810084f6>] ? default_idle+0x1e/0x32 [851916.645182] [<ffffffff810086be>] ? amd_e400_idle+0xb7/0xd4 [851916.645184] [<ffffffff810011f5>] ? cpu_idle+0x5a/0x94 [851916.645185] [<ffffffff81881a5e>] ? start_kernel+0x326/0x331 [851916.590675] [<ffffffff812032d2>] ? rb_next+0x2b/0x3f [851916.590675] [<ffffffff81204f81>] ? timerqueue_del+0x44/0x63 [851916.590675] [<ffffffff81045b7f>] ? __remove_hrtimer+0x2a/0x82 [851916.590675] [<ffffffff81045eeb>] ? __hrtimer_start_range_ns+0x68/0x269 [851916.590675] [<ffffffff81038067>] ? get_next_timer_interrupt+0x18d/0x203 [851916.590675] [<ffffffff810077dc>] ? read_tsc+0x5/0x14 [851916.590675] [<ffffffff810011bf>] ? cpu_idle+0x24/0x94 [851916.646041] panic occurred, switching back to text console [851916.590675] panic occurred, switching back to text console
Latest error was probably result of bad RAM. But after memory replace, original error hits me again: [16456.293621] general protection fault: 0000 [#1] SMP [16456.294001] CPU 3 [16456.294001] Modules linked in: it87_wdt it87 hwmon_vid netconsole k10temp [16456.294001] [16456.294001] Pid: 583, comm: kswapd0 Not tainted 3.2.6-Slackware #2 Gigabyte Technology Co., Ltd. GA-880GA-UD3H/GA-880GA-UD3H [16456.294001] RIP: 0010:[<ffffffff81082848>] [<ffffffff81082848>] page_evictable+0x14/0x7b [16456.294001] RSP: 0018:ffff88011948fc10 EFLAGS: 00010202 [16456.294001] RAX: 01ff8800d746e0e0 RBX: ffffea0002de82c0 RCX: ffff88011948fca8 [16456.294001] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffea0002de82c0 [16456.294001] RBP: ffff88011948fe48 R08: 0000000000000000 R09: 0000000000000002 [16456.294001] R10: 0000000000007787 R11: 0000000000007787 R12: 0000000000000000 [16456.294001] R13: ffffea0002de82e0 R14: 0000000000000003 R15: ffffea0002de82c0 [16456.294001] FS: 00007f0666698740(0000) GS:ffff88011fd80000(0000) knlGS:0000000000000000 [16456.294001] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b [16456.294001] CR2: 00007f06666ae000 CR3: 00000000a3ad4000 CR4: 00000000000006e0 [16456.294001] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [16456.294001] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [16456.294001] Process kswapd0 (pid: 583, threadinfo ffff88011948e000, task ffff88011a86b960) [16456.294001] Stack: [16456.294001] ffff88011fffb700 ffff88011948fe48 0000000000000001 ffffffff81083651 [16456.294001] 0000000000000001 0000000000000003 0000000000000001 ffffffff00000002 [16456.294001] ffff88011948fc70 0000000000000000 ffff88011fffbb80 000000161a86b960 [16456.294001] Call Trace: [16456.294001] [<ffffffff81083651>] ? shrink_active_list.isra.46+0x166/0x263 [16456.294001] [<ffffffff81083a64>] ? shrink_zone+0x316/0x45c [16456.294001] [<ffffffff8108467f>] ? kswapd+0x491/0x71b [16456.294001] [<ffffffff810435fe>] ? add_wait_queue+0x3c/0x3c [16456.294001] [<ffffffff810841ee>] ? try_to_free_pages+0x418/0x418 [16456.294001] [<ffffffff81043013>] ? kthread+0x76/0x7e [16456.294001] [<ffffffff814c53f4>] ? kernel_thread_helper+0x4/0x10 [16456.294001] [<ffffffff81042f9d>] ? kthread_worker_fn+0x12f/0x12f [16456.294001] [<ffffffff814c53f0>] ? gs_change+0xb/0xb [16456.294001] Code: fd 10 54 86 81 48 8b b8 c0 40 00 00 48 85 ff 74 05 e9 e8 07 fc ff c3 41 54 49 89 f4 55 53 48 89 fb e8 02 f3 ff ff 48 85 c0 74 0d <48> 8b 40 78 31 ed a9 00 00 00 08 75 53 48 8b 03 31 ed a9 00 00 [16456.294001] RIP [<ffffffff81082848>] page_evictable+0x14/0x7b [16456.294001] RSP <ffff88011948fc10> [16456.345105] ---[ end trace dd6be004b6df3ca3 ]--- [16456.863851] general protection fault: 0000 [#2] SMP [16456.864003] CPU 2 [16456.864003] Modules linked in: it87_wdt it87 hwmon_vid netconsole k10temp [16456.864003] [16456.864003] Pid: 2992, comm: rdiff-backup Tainted: G D 3.2.6-Slackware #2 Gigabyte Technology Co., Ltd. GA-880GA-UD3H/GA-880GA-UD3H [16456.864003] RIP: 0010:[<ffffffff81082848>] [<ffffffff81082848>] page_evictable+0x14/0x7b [16456.864003] RSP: 0018:ffff88007094b848 EFLAGS: 00010202 [16456.864003] RAX: 01ff8800d746e0e0 RBX: ffffea0002de8340 RCX: ffff88007094b8e0 [16456.864003] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffea0002de8340 [16456.864003] RBP: ffff88007094ba40 R08: 0000000000000000 R09: 0000000000000002 [16456.864003] R10: 0000000000000042 R11: 0000000000000042 R12: 0000000000000000 [16456.864003] R13: ffffea0002de8360 R14: 0000000000000020 R15: ffffea0002de8340 [16456.864003] FS: 00007f0666698740(0000) GS:ffff88011fd00000(0000) knlGS:0000000000000000 [16456.864003] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [16456.864003] CR2: 00007f06666ad000 CR3: 00000000a3ad4000 CR4: 00000000000006e0 [16456.864003] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [16456.864003] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [16456.864003] Process rdiff-backup (pid: 2992, threadinfo ffff88007094a000, task ffff88011996aca0) [16456.864003] Stack: [16456.864003] ffff88011fffb700 ffff88007094ba40 0000000000000001 ffffffff81083651 [16456.864003] 0000000000000001 0000000000000020 0000000000000001 ffffffff00000002 [16456.864003] ffff88007094b8a8 0000000000000000 ffff88011fffbb80 000000161996aca0 [16456.864003] Call Trace: [16456.893035] [<ffffffff81083651>] ? shrink_active_list.isra.46+0x166/0x263 [16456.893035] [<ffffffff81083a64>] ? shrink_zone+0x316/0x45c This is from netconsole and ends in the middle, sorry Form fist report I found on the net other people hit probably by this same issue. This is show up lately so is probably related to something changed not long time ago. See: http://www.linuxforums.org/forum/kernel/186920-kswapd0-general-protection-fault.html http://www.binrand.com/post/792778-mar-xfs-kernel-panics.html And some iranian site - where I cannot fount trace showed by google. I suspect this can be caused by commits in 3.2.2 from 26 january - 4556a6d95ae899263a3e63df1d3556e5cc6d3dd7 and 2a4073c2bb288193f5e7a0d57e9cf2f9786dddc3 but I haven't any proof to confirm that.
I make some analysis to this fault. Since I'm not familiar with kernel design, i isn't very deep but it may help you. Crash occur here: int page_evictable(struct page *page, struct vm_area_struct *vma) { if (mapping_unevictable(page_mapping(page))) It occurs on "mapping_unevictable" where mapping, returned by "page_mapping", field flags are tested. Exactly this is on dereferencing (&mapping->flags) Analysing dissassemble tells me that RAX have mapping address and RBX page address. "page_mapping" can return either mapping saved in page struct (page->mapping), swapper_space or NULL. Since EAX is not NULL only first two are possible. We are have more than 1 fault, each of it have same EAX but different EBX. This make more possible that "swapper_space" is broken, because it's highly unlikely that page->mapping on different pages are broken in same way. However this can happen on page structs creations, where same "already broken" address is assigned to it. I hope it helps you in some way. PS. I have 8 independent swaps on 8 devices, can it be connected to this in some way (ie. swaped swapper_space)?
This bug hit my again. Now on kernel 3.14.4. Trace from netconsole: [4108205.743819] general protection fault: 0000 [#1] SMP [4108205.747470] Modules linked in: it87_wdt it87 hwmon_vid netconsole k10temp [4108205.751126] CPU: 1 PID: 600 Comm: kswapd0 Not tainted 3.14.4-Slackware #1 [4108205.754819] Hardware name: Gigabyte Technology Co., Ltd. GA-880GA-UD3H/GA-880GA-UD3H, BIOS F7 11/24/2010 [4108205.758601] task: ffff880119801770 ti: ffff880119ade000 task.ti: ffff880119ade000 [4108205.762392] RIP: 0010:[<ffffffff8109db70>] [<ffffffff8109db70>] page_evictable+0xe/0x2b [4108205.766248] RSP: 0018:ffff880119adfa70 EFLAGS: 00010206 [4108205.770090] RAX: 7fff88010297c5c0 RBX: ffffea0002851300 RCX: 000000011fdd553d [4108205.773963] RDX: 0000000000000000 RSI: ffffea000269c340 RDI: ffffea0002851300 [4108205.777842] RBP: ffffea0002851300 R08: ffff880119adfbd0 R09: ffffea000008d800 [4108205.781714] R10: 000000000000b84b R11: 0000000119ddec00 R12: ffff88010297c5c0 [4108205.785606] R13: ffff880119adfdc8 R14: 0000000000000001 R15: 0000000000000001 [4108205.789522] FS: 00007fbac27b1740(0000) GS:ffff88011fc80000(0000) knlGS:0000000000000000 [4108205.793464] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b [4108205.797327] CR2: 00007f5921833000 CR3: 0000000119a5f000 CR4: 00000000000007e0 [4108205.801189] Stack: [4108205.804961] ffffea0002851320 ffffffff8109dd2d ffff880119adfbf8 0000000000000005 [4108205.808864] 0000000019adfb00 0000000000000000 0000000000000000 0000000000000000 [4108205.812757] 0000000000000000 0000000000000000 ffff88011fffa600 ffff880119adfbd0 [4108205.816638] Call Trace: [4108205.820370] [<ffffffff8109dd2d>] ? shrink_page_list+0x10d/0x831 [4108205.824098] [<ffffffff8109e9ce>] ? shrink_inactive_list+0x240/0x36a [4108205.827814] [<ffffffff8109f10f>] ? shrink_lruvec+0x371/0x4d2 [4108205.831497] [<ffffffff8109f2c9>] ? shrink_zone+0x59/0x142 [4108205.835154] [<ffffffff8109ff0f>] ? balance_pgdat+0x31a/0x4ab [4108205.838756] [<ffffffff810a0349>] ? kswapd+0x2a9/0x2d3 [4108205.842302] [<ffffffff81059aa9>] ? finish_wait+0x60/0x60 [4108205.845803] [<ffffffff810a00a0>] ? balance_pgdat+0x4ab/0x4ab [4108205.849292] [<ffffffff810487de>] ? kthread+0x9e/0xa6 [4108205.852806] [<ffffffff81040000>] ? SyS_setfsuid+0x91/0xa0 [4108205.856300] [<ffffffff81048740>] ? __kthread_parkme+0x55/0x55 [4108205.859760] [<ffffffff815edf3c>] ? ret_from_fork+0x7c/0xb0 [4108205.863191] [<ffffffff81048740>] ? __kthread_parkme+0x55/0x55 [4108205.866566] Code: ff 74 18 e8 50 ab fa ff 48 8b 04 dd e0 bb ab 81 48 c7 80 e0 3c 00 00 00 00 00 00 5b c3 53 48 89 fb e8 85 66 00 00 48 85 c0 74 0e <48> 8b 50 78 31 c0 f7 c2 00 00 00 10 75 0d 48 8b 03 48 c1 e8 15 [4108205.874001] RIP [<ffffffff8109db70>] page_evictable+0xe/0x2b [4108205.877608] RSP <ffff880119adfa70> [4108205.898525] ---[ end trace cd88227ee7611cdb ]---