Bug 216953
| Summary: | BUG: kernel NULL pointer dereference, address: 0000000000000008 | ||
|---|---|---|---|
| Product: | Other | Reporter: | Gene (gjunk2) |
| Component: | Loadable Security Modules (LSM) | Assignee: | Other/LSM (other_lsm) |
| Status: | NEW --- | ||
| Severity: | normal | CC: | aros, tytso |
| Priority: | P1 | ||
| Hardware: | Intel | ||
| OS: | Linux | ||
| Kernel Version: | 6.1.7 | Subsystem: | |
| Regression: | Yes | Bisected commit-id: | |
| Attachments: |
kernel config
ver_linux output crash log log run rhought decode_stacktrace |
||
Created attachment 303628 [details]
ver_linux output
Created attachment 303629 [details]
crash log
Created attachment 303630 [details]
log run rhought decode_stacktrace
system also has 2 x 8TB usb drives using btrfs - but last read/write on that filesystem was 7 or more hours before the crash. To save trouble from people who might need to download and read the attachment, here it is: Jan 19 08:25:35 serv209 kernel: RIP: 0010:selinux_inode_free_security+0x5b/0x90 Jan 19 08:25:35 serv209 kernel: Code: 8b 43 08 4c 8d 63 08 48 03 aa 70 03 00 00 49 39 c4 74 2f 48 83 c5 40 48 89 ef e8 20 53 7c 00 48 8b 53 08 48 8b 43 10 48 89 ef <48> 89 42 08 48 89 10 4c 89 63 08 4c 89 6 3 10 5b 5d 41 5c e9 6d 54 Jan 19 08:25:35 serv209 kernel: RSP: 0018:ffffb45c404e7ac0 EFLAGS: 00010246 Jan 19 08:25:35 serv209 kernel: RAX: 0000000000000000 RBX: ffff9e7e98002da0 RCX: 0000000000000000 Jan 19 08:25:35 serv209 kernel: RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff9e7c8af2c400 Jan 19 08:25:35 serv209 kernel: RBP: ffff9e7c8af2c400 R08: 0000000000000000 R09: 0000000000000000 Jan 19 08:25:35 serv209 kernel: R10: 0000000000000000 R11: 0000000000000000 R12: ffff9e7e98002da8 Jan 19 08:25:35 serv209 kernel: R13: ffff9e7c8d7ea800 R14: 0000000000201c2b R15: 000000008070ac00 Jan 19 08:25:35 serv209 kernel: FS: 0000000000000000(0000) GS:ffff9e83cf080000(0000) knlGS:00000000000 00000 Jan 19 08:25:35 serv209 kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Jan 19 08:25:35 serv209 kernel: CR2: 0000000000000008 CR3: 000000083b610006 CR4: 00000000003706e0 Jan 19 08:25:35 serv209 kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 Jan 19 08:25:35 serv209 kernel: DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Jan 19 08:25:35 serv209 kernel: Call Trace: Jan 19 08:25:35 serv209 kernel: <TASK> Jan 19 08:25:35 serv209 kernel: security_inode_free+0x31/0x70 Jan 19 08:25:35 serv209 kernel: __destroy_inode+0x71/0x180 Jan 19 08:25:35 serv209 kernel: destroy_inode+0x2d/0x80 Jan 19 08:25:35 serv209 kernel: prune_icache_sb+0x7c/0xc0 Jan 19 08:25:35 serv209 kernel: super_cache_scan+0x15e/0x1f0 Jan 19 08:25:35 serv209 kernel: do_shrink_slab+0x13e/0x2f0 Jan 19 08:25:35 serv209 kernel: shrink_slab+0x1f8/0x2a0 Jan 19 08:25:35 serv209 kernel: shrink_node+0x21c/0x720 Jan 19 08:25:35 serv209 kernel: balance_pgdat+0x313/0xa70 Jan 19 08:25:35 serv209 kernel: ? __schedule+0x37f/0x1290 Jan 19 08:25:35 serv209 kernel: ? get_nohz_timer_target+0x1c/0x1a0 Jan 19 08:25:35 serv209 kernel: kswapd+0x1fb/0x3c0 Jan 19 08:25:35 serv209 kernel: ? destroy_sched_domains_rcu+0x30/0x30 Jan 19 08:25:35 serv209 kernel: ? balance_pgdat+0xa70/0xa70 Jan 19 08:25:35 serv209 kernel: kthread+0xed/0x120 Jan 19 08:25:35 serv209 kernel: ? kthread_complete_and_exit+0x20/0x20 Jan 19 08:25:35 serv209 kernel: ret_from_fork+0x1f/0x30 Jan 19 08:25:35 serv209 kernel: </TASK> If selinux is not being used, it's... strange that we could have ended up in this path, since it requires inode->i_security being set and the LSM code deciding that selinux was enabled (and so it called selinux_inode_free_security). In any case, this is very clearly not an ext4 bug, so I'm going to pass this off to the linux-security-module list for them to investigate. Without a reliable reproducer, though, there may not be much that any of us can do... Thanks Ted - sorry to not have a reproducer - this is the only machine that had a problem and just the once (so far!) I have a second machine running same kernel also with mdadm RAID 6 setup with ext4 - but no problems on that one as of now. The other item of note, perhaps, is the compiler used was gcc 12.2.1 - earlier kernels used 12.2.0. Build started on fresh base (git -fddx). Thanks again and sorry for pointing this down the wrong road. Happened again now running 6.1.9 the (ext4) raid drives are backed up to (btrfs) on 2 usb drives using rsync. The crash happened while this was in progress. Feb 03 03:06:49 serv209 kernel: BUG: kernel NULL pointer dereference, address: 0000000000000008 Feb 03 03:06:49 serv209 kernel: #PF: supervisor write access in kernel mode Feb 03 03:06:49 serv209 kernel: #PF: error_code(0x0002) - not-present page Feb 03 03:06:49 serv209 kernel: PGD 0 P4D 0 Feb 03 03:06:49 serv209 kernel: Oops: 0002 [#1] PREEMPT SMP PTI Feb 03 03:06:49 serv209 kernel: CPU: 6 PID: 109 Comm: kswapd0 Tainted: G T 6.1.9-1-s> Feb 03 03:06:49 serv209 kernel: Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./Z370 Ex> Feb 03 03:06:49 serv209 kernel: RIP: 0010:selinux_inode_free_security+0x5b/0x90 Feb 03 03:06:49 serv209 kernel: Code: 8b 43 08 4c 8d 63 08 48 03 aa 70 03 00 00 49 39 c4 74 2f 48 83> Feb 03 03:06:49 serv209 kernel: RSP: 0018:ffffbba2804e7ac0 EFLAGS: 00010246 Feb 03 03:06:49 serv209 kernel: RAX: 0000000000000000 RBX: ffff95f7e066ffd0 RCX: 0000000000000000 Feb 03 03:06:49 serv209 kernel: RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff95f7c6450d60 Feb 03 03:06:49 serv209 kernel: RBP: ffff95f7c6450d60 R08: 0000000000000000 R09: 0000000000000000 Feb 03 03:06:49 serv209 kernel: R10: 0000000000000000 R11: 0000000000000000 R12: ffff95f7e066ffd8 Feb 03 03:06:49 serv209 kernel: R13: ffff95f7c5d4b000 R14: 00000000000c2c63 R15: 0000000030b18c00 Feb 03 03:06:49 serv209 kernel: FS: 0000000000000000(0000) GS:ffff95ff2eb80000(0000) knlGS:00000000> Feb 03 03:06:49 serv209 kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Feb 03 03:06:49 serv209 kernel: CR2: 0000000000000008 CR3: 000000083aa96004 CR4: 00000000003706e0 Feb 03 03:06:49 serv209 kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 Feb 03 03:06:49 serv209 kernel: DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Feb 03 03:06:49 serv209 kernel: Call Trace: Feb 03 03:06:49 serv209 kernel: <TASK> Feb 03 03:06:49 serv209 kernel: security_inode_free+0x31/0x70 Feb 03 03:06:49 serv209 kernel: __destroy_inode+0x71/0x180 Feb 03 03:06:49 serv209 kernel: destroy_inode+0x2d/0x80 Feb 03 03:06:49 serv209 kernel: prune_icache_sb+0x7c/0xc0 Feb 03 03:06:49 serv209 kernel: super_cache_scan+0x15e/0x1f0 Feb 03 03:06:49 serv209 kernel: do_shrink_slab+0x13e/0x2f0 Feb 03 03:06:49 serv209 kernel: shrink_slab+0x1f8/0x2a0 Feb 03 03:06:49 serv209 kernel: shrink_node+0x21c/0x720 Feb 03 03:06:49 serv209 kernel: balance_pgdat+0x313/0xa70 Feb 03 03:06:49 serv209 kernel: ? _raw_spin_unlock+0x19/0x50 Feb 03 03:06:49 serv209 kernel: ? finish_task_switch.isra.0+0x94/0x2b0 Feb 03 03:06:49 serv209 kernel: kswapd+0x1fb/0x3c0 Feb 03 03:06:49 serv209 kernel: ? destroy_sched_domains_rcu+0x30/0x30 Feb 03 03:06:49 serv209 kernel: ? balance_pgdat+0xa70/0xa70 Feb 03 03:06:49 serv209 kernel: kthread+0xed/0x120 Feb 03 03:06:49 serv209 kernel: ? kthread_complete_and_exit+0x20/0x20 Feb 03 03:06:49 serv209 kernel: ret_from_fork+0x1f/0x30 Feb 03 03:06:49 serv209 kernel: </TASK> Feb 03 03:06:49 serv209 kernel: Modules linked in: ccm algif_aead cbc des_generic libdes ecb algif_s> Feb 03 03:06:49 serv209 kernel: intel_uncore mxm_wmi intel_wmi_thunderbolt evdev rfkill mac_hid acp> Feb 03 03:06:49 serv209 kernel: CR2: 0000000000000008 Feb 03 03:06:49 serv209 kernel: ---[ end trace 0000000000000000 ]--- Feb 03 03:06:49 serv209 kernel: RIP: 0010:selinux_inode_free_security+0x5b/0x90 Feb 03 03:06:49 serv209 kernel: Code: 8b 43 08 4c 8d 63 08 48 03 aa 70 03 00 00 49 39 c4 74 2f 48 83> Feb 03 03:06:49 serv209 kernel: RSP: 0018:ffffbba2804e7ac0 EFLAGS: 00010246 Feb 03 03:06:49 serv209 kernel: RAX: 0000000000000000 RBX: ffff95f7e066ffd0 RCX: 0000000000000000 Feb 03 03:06:49 serv209 kernel: RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff95f7c6450d60 Feb 03 03:06:49 serv209 kernel: RBP: ffff95f7c6450d60 R08: 0000000000000000 R09: 0000000000000000 Feb 03 03:06:49 serv209 kernel: R10: 0000000000000000 R11: 0000000000000000 R12: ffff95f7e066ffd8 I dont know if its useful or not but right after the above OOPS there is additional bad things - I assume the first one is the important one but in case its useful here's the next part of log: Feb 03 03:06:49 : note: kswapd0[109] exited with preempt_count 1 Feb 03 03:07:17 : watchdog: BUG: soft lockup - CPU#1 stuck for 27s! [rsync:541955] Feb 03 03:07:17 : Modules linked in: ccm algif_aead cbc des_generic libdes ecb algif_s> Feb 03 03:07:17 : intel_uncore mxm_wmi intel_wmi_thunderbolt evdev rfkill mac_hid acp> Feb 03 03:07:17 : CPU: 1 PID: 541955 Comm: rsync Tainted: G D T 6.1.9-1-> Feb 03 03:07:17 : Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./Z370 Ex> Feb 03 03:07:17 : RIP: 0010:native_queued_spin_lock_slowpath+0x7b/0x310 Feb 03 03:07:17 : Code: 00 00 00 f0 0f ba 2b 08 0f 92 c2 8b 03 0f b6 d2 c1 e2 08 30 e4> Feb 03 03:07:17 : RSP: 0018:ffffbba282abfb00 EFLAGS: 00000202 Feb 03 03:07:17 : RAX: 0000000000000101 RBX: ffff95f7c6450d60 RCX: 0000000000000000 Feb 03 03:07:17 : RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff95f7c6450d60 Feb 03 03:07:17 : RBP: ffff95fd9f93bf14 R08: 0000000000000000 R09: 0000000000000000 Feb 03 03:07:17 : R10: 0000000000000000 R11: ffff95f7c6450d20 R12: ffff95fe567ceed8 Feb 03 03:07:17 : R13: ffff95f7c6450d20 R14: ffff95fa80de44f8 R15: ffff95fd9f93bef0 Feb 03 03:07:17 : FS: 00007f1b94a9f740(0000) GS:ffff95ff2ea40000(0000) knlGS:00000000> Feb 03 03:07:17 : CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Feb 03 03:07:17 : CR2: 00007f1b93eec000 CR3: 000000083aa96005 CR4: 00000000003706e0 Feb 03 03:07:17 : DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 Feb 03 03:07:17 : DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Feb 03 03:07:17 : Call Trace: Feb 03 03:07:17 : <TASK> Feb 03 03:07:17 : _raw_spin_lock+0x4a/0x70 Feb 03 03:07:17 : inode_doinit_with_dentry+0x1c6/0x4f0 Feb 03 03:07:17 : security_d_instantiate+0x39/0x60 Feb 03 03:07:17 : d_splice_alias+0x4a/0x2a0 Feb 03 03:07:17 : __lookup_slow+0x8e/0x140 Feb 03 03:07:17 : walk_component+0xe7/0x160 Feb 03 03:07:17 : path_lookupat+0x73/0x1c0 Feb 03 03:07:17 : filename_lookup+0xe9/0x210 Feb 03 03:07:17 : vfs_statx+0x9e/0x190 Feb 03 03:07:17 : vfs_fstatat+0x55/0x80 Feb 03 03:07:17 : __do_sys_newfstatat+0x44/0x90 Feb 03 03:07:17 : do_syscall_64+0x5c/0x90 Feb 03 03:07:17 : entry_SYSCALL_64_after_hwframe+0x63/0xcd Feb 03 03:07:17 : RIP: 0033:0x7f1b9450f86e Feb 03 03:07:17 : Code: 48 89 f2 b9 00 01 00 00 48 89 fe bf 9c ff ff ff e9 07 00 00 00> Feb 03 03:07:17 : RSP: 002b:00007fffb8d1b988 EFLAGS: 00000246 ORIG_RAX: 00000000000001> Feb 03 03:07:17 : RAX: ffffffffffffffda RBX: 00007fffb8d1ba90 RCX: 00007f1b9450f86e Feb 03 03:07:17 : RDX: 00007fffb8d1ba90 RSI: 00007fffb8d1cb20 RDI: 00000000ffffff9c Feb 03 03:07:17 : RBP: 00007fffb8d1cb20 R08: 00007fffb8d1cb1f R09: 0000000000000000 Feb 03 03:07:17 : R10: 0000000000000100 R11: 0000000000000246 R12: 0000000000000000 Feb 03 03:07:17 : R13: 0000000000000000 R14: 000055949b297f10 R15: 00007fffb8d1ba90 Feb 03 03:07:17 : </TASK> Feb 03 03:07:45 : watchdog: BUG: soft lockup - CPU#1 stuck for 53s! [rsync:541955] Feb 03 03:07:45 : Modules linked in: ccm algif_aead cbc des_generic libdes ecb algif_s> Feb 03 03:07:45 : intel_uncore mxm_wmi intel_wmi_thunderbolt evdev rfkill mac_hid acp> Feb 03 03:07:45 : CPU: 1 PID: 541955 Comm: rsync Tainted: G D L T 6.1.9-1-> Feb 03 03:07:45 : Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./Z370 Ex> Feb 03 03:07:45 : RIP: 0010:native_queued_spin_lock_slowpath+0x7b/0x310 Feb 03 03:07:45 : Code: 00 00 00 f0 0f ba 2b 08 0f 92 c2 8b 03 0f b6 d2 c1 e2 08 30 e4> Feb 03 03:07:45 : RSP: 0018:ffffbba282abfb00 EFLAGS: 00000202 Feb 03 03:07:45 : RAX: 0000000000000101 RBX: ffff95f7c6450d60 RCX: 0000000000000000 Feb 03 03:07:45 : RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff95f7c6450d60 Feb 03 03:07:45 : RBP: ffff95fd9f93bf14 R08: 0000000000000000 R09: 0000000000000000 Feb 03 03:07:45 : R10: 0000000000000000 R11: ffff95f7c6450d20 R12: ffff95fe567ceed8 Feb 03 03:07:45 : R13: ffff95f7c6450d20 R14: ffff95fa80de44f8 R15: ffff95fd9f93bef0 Feb 03 03:07:45 : FS: 00007f1b94a9f740(0000) GS:ffff95ff2ea40000(0000) knlGS:00000000> Feb 03 03:07:45 : CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Feb 03 03:07:45 : CR2: 00007f1b93eec000 CR3: 000000083aa96005 CR4: 00000000003706e0 Feb 03 03:07:45 : DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 Feb 03 03:07:45 : DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Feb 03 03:07:45 : Call Trace: Feb 03 03:07:45 : <TASK> Feb 03 03:07:45 : _raw_spin_lock+0x4a/0x70 Feb 03 03:07:45 : inode_doinit_with_dentry+0x1c6/0x4f0 Feb 03 03:07:45 : security_d_instantiate+0x39/0x60 Feb 03 03:07:45 : d_splice_alias+0x4a/0x2a0 Feb 03 03:07:45 : __lookup_slow+0x8e/0x140 Feb 03 03:07:45 : walk_component+0xe7/0x160 Feb 03 03:07:45 : path_lookupat+0x73/0x1c0 Feb 03 03:07:45 : filename_lookup+0xe9/0x210 Feb 03 03:07:45 : vfs_statx+0x9e/0x190 Feb 03 03:07:45 : vfs_fstatat+0x55/0x80 Feb 03 03:07:45 : __do_sys_newfstatat+0x44/0x90 Feb 03 03:07:45 : do_syscall_64+0x5c/0x90 Feb 03 03:07:45 : entry_SYSCALL_64_after_hwframe+0x63/0xcd Feb 03 03:07:45 : RIP: 0033:0x7f1b9450f86e Feb 03 03:07:45 : Code: 48 89 f2 b9 00 01 00 00 48 89 fe bf 9c ff ff ff e9 07 00 00 00> Feb 03 03:07:45 : RSP: 002b:00007fffb8d1b988 EFLAGS: 00000246 ORIG_RAX: 00000000000001> Feb 03 03:07:45 : RAX: ffffffffffffffda RBX: 00007fffb8d1ba90 RCX: 00007f1b9450f86e Feb 03 03:07:45 : RDX: 00007fffb8d1ba90 RSI: 00007fffb8d1cb20 RDI: 00000000ffffff9c Feb 03 03:07:45 : RBP: 00007fffb8d1cb20 R08: 00007fffb8d1cb1f R09: 0000000000000000 Feb 03 03:07:45 : R10: 0000000000000100 R11: 0000000000000246 R12: 0000000000000000 Feb 03 03:07:45 : R13: 0000000000000000 R14: 000055949b297f10 R15: 00007fffb8d1ba90 Feb 03 03:07:45 : </TASK> Feb 03 03:07:49 : rcu: INFO: rcu_preempt self-detected stall on CPU Feb 03 03:07:49 : rcu: 1-....: (59937 ticks this GP) idle=304c/1/0x40000000000> Feb 03 03:07:49 : (t=60002 jiffies g=16961889 q=8729 ncpus=12) Feb 03 03:07:49 : CPU: 1 PID: 541955 Comm: rsync Tainted: G D L T 6.1.9-1-> Feb 03 03:07:49 : Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./Z370 Ex> Feb 03 03:07:49 : RIP: 0010:native_queued_spin_lock_slowpath+0x7b/0x310 Feb 03 03:07:49 : Code: 00 00 00 f0 0f ba 2b 08 0f 92 c2 8b 03 0f b6 d2 c1 e2 08 30 e4> Feb 03 03:07:49 : RSP: 0018:ffffbba282abfb00 EFLAGS: 00000202 Feb 03 03:07:49 : RAX: 0000000000000101 RBX: ffff95f7c6450d60 RCX: 0000000000000000 Feb 03 03:07:49 : RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff95f7c6450d60 Feb 03 03:07:49 : RBP: ffff95fd9f93bf14 R08: 0000000000000000 R09: 0000000000000000 Feb 03 03:07:49 : R10: 0000000000000000 R11: ffff95f7c6450d20 R12: ffff95fe567ceed8 Feb 03 03:07:49 : R13: ffff95f7c6450d20 R14: ffff95fa80de44f8 R15: ffff95fd9f93bef0 Feb 03 03:07:49 : FS: 00007f1b94a9f740(0000) GS:ffff95ff2ea40000(0000) knlGS:00000000> Feb 03 03:07:49 : CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Feb 03 03:07:49 : CR2: 00007f1b93eec000 CR3: 000000083aa96005 CR4: 00000000003706e0 Feb 03 03:07:49 : DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 Feb 03 03:07:49 : DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Feb 03 03:07:49 : Call Trace: Feb 03 03:07:49 : <TASK> Feb 03 03:07:49 : _raw_spin_lock+0x4a/0x70 Feb 03 03:07:49 : inode_doinit_with_dentry+0x1c6/0x4f0 Feb 03 03:07:49 : security_d_instantiate+0x39/0x60 Feb 03 03:07:49 : d_splice_alias+0x4a/0x2a0 Feb 03 03:07:49 : __lookup_slow+0x8e/0x140 Feb 03 03:07:49 : walk_component+0xe7/0x160 Feb 03 03:07:49 : path_lookupat+0x73/0x1c0 Feb 03 03:07:49 : filename_lookup+0xe9/0x210 Feb 03 03:07:49 : vfs_statx+0x9e/0x190 Feb 03 03:07:49 : vfs_fstatat+0x55/0x80 Feb 03 03:07:49 : __do_sys_newfstatat+0x44/0x90 Feb 03 03:07:49 : do_syscall_64+0x5c/0x90 Feb 03 03:07:49 : entry_SYSCALL_64_after_hwframe+0x63/0xcd Feb 03 03:07:49 : RIP: 0033:0x7f1b9450f86e Feb 03 03:07:49 : Code: 48 89 f2 b9 00 01 00 00 48 89 fe bf 9c ff ff ff e9 07 00 00 00> Feb 03 03:07:49 : RSP: 002b:00007fffb8d1b988 EFLAGS: 00000246 ORIG_RAX: 00000000000001> Feb 03 03:07:49 : RAX: ffffffffffffffda RBX: 00007fffb8d1ba90 RCX: 00007f1b9450f86e Feb 03 03:07:49 : RDX: 00007fffb8d1ba90 RSI: 00007fffb8d1cb20 RDI: 00000000ffffff9c Feb 03 03:07:49 : RBP: 00007fffb8d1cb20 R08: 00007fffb8d1cb1f R09: 0000000000000000 Feb 03 03:07:49 : R10: 0000000000000100 R11: 0000000000000246 R12: 0000000000000000 Feb 03 03:07:49 : R13: 0000000000000000 R14: 000055949b297f10 R15: 00007fffb8d1ba90 Feb 03 03:07:49 : </TASK> Feb 03 03:08:17 : watchdog: BUG: soft lockup - CPU#1 stuck for 82s! [rsync:541955] Feb 03 03:08:17 : Modules linked in: ccm algif_aead cbc des_generic libdes ecb algif_s> Feb 03 03:08:17 : intel_uncore mxm_wmi intel_wmi_thunderbolt evdev rfkill mac_hid acp> Feb 03 03:08:17 : CPU: 1 PID: 541955 Comm: rsync Tainted: G D L T 6.1.9-1-> Feb 03 03:08:17 : Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./Z370 Ex> Feb 03 03:08:17 : RIP: 0010:native_queued_spin_lock_slowpath+0x7b/0x310 Feb 03 03:08:17 : Code: 00 00 00 f0 0f ba 2b 08 0f 92 c2 8b 03 0f b6 d2 c1 e2 08 30 e4> Feb 03 03:08:17 : RSP: 0018:ffffbba282abfb00 EFLAGS: 00000202 Feb 03 03:08:17 : RAX: 0000000000000101 RBX: ffff95f7c6450d60 RCX: 0000000000000000 Feb 03 03:08:17 : RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff95f7c6450d60 Feb 03 03:08:17 : RBP: ffff95fd9f93bf14 R08: 0000000000000000 R09: 0000000000000000 Feb 03 03:08:17 : R10: 0000000000000000 R11: ffff95f7c6450d20 R12: ffff95fe567ceed8 Feb 03 03:08:17 : R13: ffff95f7c6450d20 R14: ffff95fa80de44f8 R15: ffff95fd9f93bef0 Feb 03 03:08:17 : FS: 00007f1b94a9f740(0000) GS:ffff95ff2ea40000(0000) knlGS:00000000> Feb 03 03:08:17 : CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Feb 03 03:08:17 : CR2: 00007f1b93eec000 CR3: 000000083aa96005 CR4: 00000000003706e0 Feb 03 03:08:17 : DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 Feb 03 03:08:17 : DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Feb 03 03:08:17 : Call Trace: Feb 03 03:08:17 : <TASK> Feb 03 03:08:17 : _raw_spin_lock+0x4a/0x70 Feb 03 03:08:17 : inode_doinit_with_dentry+0x1c6/0x4f0 Feb 03 03:08:17 : security_d_instantiate+0x39/0x60 Feb 03 03:08:17 : d_splice_alias+0x4a/0x2a0 Feb 03 03:08:17 : __lookup_slow+0x8e/0x140 Feb 03 03:08:17 : walk_component+0xe7/0x160 Feb 03 03:08:17 : path_lookupat+0x73/0x1c0 Feb 03 03:08:17 : filename_lookup+0xe9/0x210 Feb 03 03:08:17 : vfs_statx+0x9e/0x190 Feb 03 03:08:17 : vfs_fstatat+0x55/0x80 Feb 03 03:08:17 : __do_sys_newfstatat+0x44/0x90 Feb 03 03:08:17 : do_syscall_64+0x5c/0x90 Feb 03 03:08:17 : entry_SYSCALL_64_after_hwframe+0x63/0xcd Feb 03 03:08:17 : RIP: 0033:0x7f1b9450f86e Feb 03 03:08:17 : Code: 48 89 f2 b9 00 01 00 00 48 89 fe bf 9c ff ff ff e9 07 00 00 00> Feb 03 03:08:17 : RSP: 002b:00007fffb8d1b988 EFLAGS: 00000246 ORIG_RAX: 00000000000001> Feb 03 03:08:17 : RAX: ffffffffffffffda RBX: 00007fffb8d1ba90 RCX: 00007f1b9450f86e Feb 03 03:08:17 : RDX: 00007fffb8d1ba90 RSI: 00007fffb8d1cb20 RDI: 00000000ffffff9c Feb 03 03:08:17 : RBP: 00007fffb8d1cb20 R08: 00007fffb8d1cb1f R09: 0000000000000000 Feb 03 03:08:17 : R10: 0000000000000100 R11: 0000000000000246 R12: 0000000000000000 Feb 03 03:08:17 : R13: 0000000000000000 R14: 000055949b297f10 R15: 00007fffb8d1ba90 Feb 03 03:08:17 : </TASK> Feb 03 03:08:45 : watchdog: BUG: soft lockup - CPU#1 stuck for 109s! [rsync:541955] Feb 03 03:08:45 : Modules linked in: ccm algif_aead cbc des_generic libdes ecb algif_s> Feb 03 03:08:45 : intel_uncore mxm_wmi intel_wmi_thunderbolt evdev rfkill mac_hid acp> Feb 03 03:08:45 : CPU: 1 PID: 541955 Comm: rsync Tainted: G D L T 6.1.9-1-> Feb 03 03:08:45 : Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./Z370 Ex> Feb 03 03:08:45 : RIP: 0010:native_queued_spin_lock_slowpath+0x7d/0x310 Feb 03 03:08:45 : Code: 00 f0 0f ba 2b 08 0f 92 c2 8b 03 0f b6 d2 c1 e2 08 30 e4 09 d0> Feb 03 03:08:45 : RSP: 0018:ffffbba282abfb00 EFLAGS: 00000202 Feb 03 03:08:45 : RAX: 0000000000000101 RBX: ffff95f7c6450d60 RCX: 0000000000000000 Feb 03 03:08:45 : RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff95f7c6450d60 Feb 03 03:08:45 : RBP: ffff95fd9f93bf14 R08: 0000000000000000 R09: 0000000000000000 Feb 03 03:08:45 : R10: 0000000000000000 R11: ffff95f7c6450d20 R12: ffff95fe567ceed8 Feb 03 03:08:45 : R13: ffff95f7c6450d20 R14: ffff95fa80de44f8 R15: ffff95fd9f93bef0 Feb 03 03:08:45 : FS: 00007f1b94a9f740(0000) GS:ffff95ff2ea40000(0000) knlGS:00000000> Feb 03 03:08:45 : CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Feb 03 03:08:45 : CR2: 00007f1b93eec000 CR3: 000000083aa96005 CR4: 00000000003706e0 Feb 03 03:08:45 : DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 Feb 03 03:08:45 : DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Feb 03 03:08:45 : Call Trace: Feb 03 03:08:45 : <TASK> Feb 03 03:08:45 : _raw_spin_lock+0x4a/0x70 Feb 03 03:08:45 : inode_doinit_with_dentry+0x1c6/0x4f0 Feb 03 03:08:45 : security_d_instantiate+0x39/0x60 Feb 03 03:08:45 : d_splice_alias+0x4a/0x2a0 Feb 03 03:08:45 : __lookup_slow+0x8e/0x140 Feb 03 03:08:45 : walk_component+0xe7/0x160 Feb 03 03:08:45 : path_lookupat+0x73/0x1c0 Feb 03 03:08:45 : filename_lookup+0xe9/0x210 Feb 03 03:08:45 : vfs_statx+0x9e/0x190 Feb 03 03:08:45 : vfs_fstatat+0x55/0x80 Feb 03 03:08:45 : __do_sys_newfstatat+0x44/0x90 Feb 03 03:08:45 : do_syscall_64+0x5c/0x90 Feb 03 03:08:45 : entry_SYSCALL_64_after_hwframe+0x63/0xcd Feb 03 03:08:45 : RIP: 0033:0x7f1b9450f86e Feb 03 03:08:45 : Code: 48 89 f2 b9 00 01 00 00 48 89 fe bf 9c ff ff ff e9 07 00 00 00> Feb 03 03:08:45 : RSP: 002b:00007fffb8d1b988 EFLAGS: 00000246 ORIG_RAX: 00000000000001> Feb 03 03:08:45 : RAX: ffffffffffffffda RBX: 00007fffb8d1ba90 RCX: 00007f1b9450f86e Feb 03 03:08:45 : RDX: 00007fffb8d1ba90 RSI: 00007fffb8d1cb20 RDI: 00000000ffffff9c Feb 03 03:08:45 : RBP: 00007fffb8d1cb20 R08: 00007fffb8d1cb1f R09: 0000000000000000 Feb 03 03:08:45 : R10: 0000000000000100 R11: 0000000000000246 R12: 0000000000000000 Feb 03 03:08:45 : R13: 0000000000000000 R14: 000055949b297f10 R15: 00007fffb8d1ba90 Feb 03 03:08:45 : </TASK> Feb 03 03:09:13 : watchdog: BUG: soft lockup - CPU#1 stuck for 135s! [rsync:541955] Feb 03 03:09:13 : Modules linked in: ccm algif_aead cbc des_generic libdes ecb algif_s> Feb 03 03:09:13 : intel_uncore mxm_wmi intel_wmi_thunderbolt evdev rfkill mac_hid acp> Feb 03 03:09:13 : CPU: 1 PID: 541955 Comm: rsync Tainted: G D L T 6.1.9-1-> Feb 03 03:09:13 : Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./Z370 Ex> Feb 03 03:09:13 : RIP: 0010:native_queued_spin_lock_slowpath+0x7b/0x310 Feb 03 03:09:13 : Code: 00 00 00 f0 0f ba 2b 08 0f 92 c2 8b 03 0f b6 d2 c1 e2 08 30 e4> Feb 03 03:09:13 : RSP: 0018:ffffbba282abfb00 EFLAGS: 00000202 lines 1355-1406/18399 6% ...Feb 03 03:09:13 : Code: 00 00 00 f0 0f ba 2b 08 0f 92 c2 8b 03 0f b6 d2 c1 e2 08 30 e4> Feb 03 03:09:13 : RSP: 0018:ffffbba282abfb00 EFLAGS: 00000202 Feb 03 03:09:13 : RAX: 0000000000000101 RBX: ffff95f7c6450d60 RCX: 0000000000000000 Feb 03 03:09:13 : RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff95f7c6450d60 Feb 03 03:09:13 : RBP: ffff95fd9f93bf14 R08: 0000000000000000 R09: 0000000000000000 Feb 03 03:09:13 : R10: 0000000000000000 R11: ffff95f7c6450d20 R12: ffff95fe567ceed8 Feb 03 03:09:13 : R13: ffff95f7c6450d20 R14: ffff95fa80de44f8 R15: ffff95fd9f93bef0 Feb 03 03:09:13 : FS: 00007f1b94a9f740(0000) GS:ffff95ff2ea40000(0000) knlGS:00000000> Feb 03 03:09:13 : CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Feb 03 03:09:13 : CR2: 00007f1b93eec000 CR3: 000000083aa96005 CR4: 00000000003706e0 Feb 03 03:09:13 : DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 Feb 03 03:09:13 : DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Feb 03 03:09:13 : Call Trace: Feb 03 03:09:13 : <TASK> Feb 03 03:09:13 : _raw_spin_lock+0x4a/0x70 Feb 03 03:09:13 : inode_doinit_with_dentry+0x1c6/0x4f0 Feb 03 03:09:13 : security_d_instantiate+0x39/0x60 Feb 03 03:09:13 : d_splice_alias+0x4a/0x2a0 Feb 03 03:09:13 : __lookup_slow+0x8e/0x140 Feb 03 03:09:13 : walk_component+0xe7/0x160 Feb 03 03:09:13 : path_lookupat+0x73/0x1c0 Feb 03 03:09:13 : filename_lookup+0xe9/0x210 Feb 03 03:09:13 : vfs_statx+0x9e/0x190 Feb 03 03:09:13 : vfs_fstatat+0x55/0x80 Feb 03 03:09:13 : __do_sys_newfstatat+0x44/0x90 Feb 03 03:09:13 : do_syscall_64+0x5c/0x90 Feb 03 03:09:13 : entry_SYSCALL_64_after_hwframe+0x63/0xcd Feb 03 03:09:13 : RIP: 0033:0x7f1b9450f86e Feb 03 03:09:13 : Code: 48 89 f2 b9 00 01 00 00 48 89 fe bf 9c ff ff ff e9 07 00 00 00> Feb 03 03:09:13 : RSP: 002b:00007fffb8d1b988 EFLAGS: 00000246 ORIG_RAX: 00000000000001> Feb 03 03:09:13 : RAX: ffffffffffffffda RBX: 00007fffb8d1ba90 RCX: 00007f1b9450f86e Feb 03 03:09:13 : RDX: 00007fffb8d1ba90 RSI: 00007fffb8d1cb20 RDI: 00000000ffffff9c Feb 03 03:09:13 : RBP: 00007fffb8d1cb20 R08: 00007fffb8d1cb1f R09: 0000000000000000 Feb 03 03:09:13 : R10: 0000000000000100 R11: 0000000000000246 R12: 0000000000000000 Feb 03 03:09:13 : R13: 0000000000000000 R14: 000055949b297f10 R15: 00007fffb8d1ba90 Feb 03 03:09:13 : </TASK> Feb 03 03:09:41 : watchdog: BUG: soft lockup - CPU#1 stuck for 161s! [rsync:541955] Feb 03 03:09:41 : Modules linked in: ccm algif_aead cbc des_generic libdes ecb algif_s> Feb 03 03:09:41 : intel_uncore mxm_wmi intel_wmi_thunderbolt evdev rfkill mac_hid acp> Feb 03 03:09:41 : CPU: 1 PID: 541955 Comm: rsync Tainted: G D L T 6.1.9-1-> Feb 03 03:09:41 : Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./Z370 Ex> Feb 03 03:09:41 : RIP: 0010:native_queued_spin_lock_slowpath+0x7b/0x310 Feb 03 03:09:41 : Code: 00 00 00 f0 0f ba 2b 08 0f 92 c2 8b 03 0f b6 d2 c1 e2 08 30 e4> Feb 03 03:09:41 : RSP: 0018:ffffbba282abfb00 EFLAGS: 00000202 Feb 03 03:09:41 : RAX: 0000000000000101 RBX: ffff95f7c6450d60 RCX: 0000000000000000 Feb 03 03:09:41 : RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff95f7c6450d60 Feb 03 03:09:41 : RBP: ffff95fd9f93bf14 R08: 0000000000000000 R09: 0000000000000000 Feb 03 03:09:41 : R10: 0000000000000000 R11: ffff95f7c6450d20 R12: ffff95fe567ceed8 Feb 03 03:09:41 : R13: ffff95f7c6450d20 R14: ffff95fa80de44f8 R15: ffff95fd9f93bef0 Feb 03 03:09:41 : FS: 00007f1b94a9f740(0000) GS:ffff95ff2ea40000(0000) knlGS:00000000> Feb 03 03:09:41 : CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Feb 03 03:09:41 : CR2: 00007f1b93eec000 CR3: 000000083aa96005 CR4: 00000000003706e0 Feb 03 03:09:41 : DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 |
Created attachment 303627 [details] kernel config System has RAID6 with ext4 filesystem - 6 x 8TB drives. Attached are config used to build kernel, output of ver_linux, the raw journal as well as same run through scripts/decode_stacktrace.sh. Note that while selinux is in kernel, there it is not being used. thanks.