Bug 217990

Summary: AX210 system crash within minutes after 'iwlwifi Queue stuck' error
Product: Drivers Reporter: chris (inkbottle007)
Component: network-wireless-intelAssignee: Default virtual assignee for network-wireless-intel (drivers_network-wireless-intel)
Status: NEW ---    
Severity: high CC: inkbottle007, kernel.jujitsu840, lev.lybin, pbrobinson, silver21278, soprwa
Priority: P3    
Hardware: Intel   
OS: Linux   
Kernel Version: Subsystem:
Regression: No Bisected commit-id:

Description chris 2023-10-10 00:18:27 UTC
# Description

Whenever I've got a line such as `iwlwifi ... Queue ... is stuck ...` in `journalctl` there is a system crash within 10 min maximum (spontaneous reboot). The system never recover from that error.

Out of 35 boots, at least one boot a day, there are 27 correct shutdown, none of which contains the error, and 8 system crash, all of which with the aforementioned error, and the system crashing within 10 min of the first occurrence of the error.

When crashes occur, the system is not at all under heavy load, mostly using Firefox.

# Hardware

Mobo: ASUS ROG STRIX X670E-E GAMING WIFI (latest bios, default settings)
CPU: R5-7600X
RAM: KSM48E40BD8KM-32HM
Storage: Firecuda 530 1TB
No discreet GPU

# System

```
$ hostnamectl
Operating System: NixOS 23.11 (Tapir)             
          Kernel: Linux 6.5.2
    Architecture: x86-64
 Hardware Vendor: ASUS
  Hardware Model: ROG STRIX X670E-E GAMING WIFI
Firmware Version: 1602
   Firmware Date: Tue 2023-08-15
```

# DE

kde-plasma/wayland

# iwlwifi info

```
$ systool -v -m iwlwifi
Module = "iwlwifi"

  Attributes:
    coresize            = "540672"
    initsize            = "0"
    initstate           = "live"
    refcnt              = "1"
    taint               = ""
    uevent              = <store method only>

  Parameters:
    11n_disable         = "0"
    amsdu_size          = "0"
    bt_coex_active      = "Y"
    disable_11ac        = "N"
    disable_11ax        = "N"
    disable_11be        = "N"
    fw_restart          = "Y"
    led_mode            = "0"
    nvm_file            = "(null)"
    power_level         = "0"
    power_save          = "N"
    remove_when_gone    = "N"
    swcrypto            = "0"
    uapsd_disable       = "3"
```

# iwlwifi firmware version

```
$ journalctl -b 0 | grep "firmware version"
Oct 08 14:58:24 nixos kernel: iwlwifi 0000:08:00.0: loaded firmware version 83.e8f84e98.0 ty-a0-gf-a0-83.ucode op_mode iwlmvm
```

# relevant parts of `journalctl`

Below a "short" crash:

```
*** Boot c900fd1919df40748cec0738f4950821 lacks SHUTTING DOWN message ***
*** Error found in boot c900fd1919df40748cec0738f4950821 output ***
Oct 07 02:25:54 nixos .firefox-wrappe[12813]: Unable to load hand2 from the cursor theme
Oct 07 02:25:55 nixos .firefox-wrappe[12813]: Unable to load hand2 from the cursor theme
Oct 07 02:25:55 nixos .firefox-wrappe[12813]: Unable to load hand2 from the cursor theme
Oct 07 02:25:56 nixos .firefox-wrappe[12813]: Unable to load hand2 from the cursor theme
Oct 07 02:26:08 nixos .firefox-wrappe[12813]: Unable to load hand2 from the cursor theme
Oct 07 02:26:10 nixos .firefox-wrappe[12813]: Unable to load hand2 from the cursor theme
Oct 07 02:26:22 nixos .firefox-wrappe[12813]: Unable to load hand2 from the cursor theme
Oct 07 02:26:22 nixos .firefox-wrappe[12813]: Unable to load hand2 from the cursor theme
Oct 07 02:26:22 nixos .firefox-wrappe[12813]: Unable to load hand2 from the cursor theme
Oct 07 02:26:23 nixos .firefox-wrappe[12813]: Unable to load hand2 from the cursor theme
Oct 07 02:26:24 nixos kernel: iwlwifi 0000:08:00.0: Queue 4 is stuck 2862 2888
Oct 07 02:26:44 nixos kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
Oct 07 02:26:44 nixos kernel: rcu:         8-....: (97 ticks this GP) idle=ecec/1/0x4000000000000002 softirq=856848/856848 fqs=4962
Oct 07 02:26:44 nixos kernel: rcu:         (detected by 11, t=21002 jiffies, g=5095313, q=8499 ncpus=12)
Oct 07 02:26:44 nixos kernel: Sending NMI from CPU 11 to CPUs 8:
Oct 07 02:26:44 nixos kernel: NMI backtrace for cpu 8
Oct 07 02:26:44 nixos kernel: CPU: 8 PID: 0 Comm: swapper/8 Not tainted 6.5.2 #1-NixOS
Oct 07 02:26:44 nixos kernel: Hardware name: ASUS System Product Name/ROG STRIX X670E-E GAMING WIFI, BIOS 1602 08/15/2023
Oct 07 02:26:44 nixos kernel: RIP: 0010:iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Oct 07 02:26:44 nixos kernel: Code: 1f 80 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 0f 1f 44 00 00 89 f6 48 03 b7 30 35 00 00 8b 06 <e9> 97 4a 08 e3 0f 1f 80 00 00 00 00 90 90 90 90 90 90 90 90 90 90
Oct 07 02:26:44 nixos kernel: RSP: 0018:ffff9c1300390df8 EFLAGS: 00000286
Oct 07 02:26:44 nixos kernel: RAX: 00000000ffffffff RBX: ffff9207c53b8028 RCX: 0000000000000008
Oct 07 02:26:44 nixos kernel: RDX: 0000000000000c4d RSI: ffff9c130582c024 RDI: ffff9207c53b8028
Oct 07 02:26:44 nixos kernel: RBP: 0000000000000011 R08: 0000000000003a98 R09: ffff9c1300390be0
Oct 07 02:26:44 nixos kernel: R10: 0000000000000003 R11: ffffffffa5138788 R12: 0000000000000024
Oct 07 02:26:44 nixos kernel: R13: 0000000000000024 R14: ffff9207c53b8028 R15: 0000000000003a98
Oct 07 02:26:44 nixos kernel: FS:  0000000000000000(0000) GS:ffff920ef8800000(0000) knlGS:0000000000000000
Oct 07 02:26:44 nixos kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Oct 07 02:26:44 nixos kernel: CR2: 00007f86c7bab010 CR3: 00000004ffa20000 CR4: 0000000000750ee0
Oct 07 02:26:44 nixos kernel: PKRU: 55555554
Oct 07 02:26:44 nixos kernel: Call Trace:
Oct 07 02:26:44 nixos kernel:  <NMI>
Oct 07 02:26:44 nixos kernel:  ? nmi_cpu_backtrace+0x99/0x110
Oct 07 02:26:44 nixos kernel:  ? nmi_cpu_backtrace_handler+0x11/0x20
Oct 07 02:26:44 nixos kernel:  ? nmi_handle+0x5e/0x150
Oct 07 02:26:44 nixos kernel:  ? default_do_nmi+0x40/0x100
Oct 07 02:26:44 nixos kernel:  ? exc_nmi+0x139/0x1c0
Oct 07 02:26:44 nixos kernel:  ? end_repeat_nmi+0x16/0x67
Oct 07 02:26:44 nixos kernel:  ? iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Oct 07 02:26:44 nixos kernel:  ? iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Oct 07 02:26:44 nixos kernel:  ? iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Oct 07 02:26:44 nixos kernel:  </NMI>
Oct 07 02:26:44 nixos kernel:  <IRQ>
Oct 07 02:26:44 nixos kernel:  iwl_read32+0x20/0x80 [iwlwifi]
Oct 07 02:26:44 nixos kernel:  iwl_poll_bit+0x42/0x70 [iwlwifi]
Oct 07 02:26:44 nixos kernel:  __iwl_trans_pcie_grab_nic_access+0xb7/0x150 [iwlwifi]
Oct 07 02:26:44 nixos kernel:  ? __pfx_iwl_txq_stuck_timer+0x10/0x10 [iwlwifi]
Oct 07 02:26:44 nixos kernel:  iwl_trans_pcie_grab_nic_access+0x1a/0x40 [iwlwifi]
Oct 07 02:26:44 nixos kernel:  iwl_force_nmi+0xc8/0xe0 [iwlwifi]
Oct 07 02:26:44 nixos kernel:  call_timer_fn+0x24/0x130
Oct 07 02:26:44 nixos kernel:  ? __pfx_iwl_txq_stuck_timer+0x10/0x10 [iwlwifi]
Oct 07 02:26:44 nixos kernel:  __run_timers+0x222/0x2c0
Oct 07 02:26:44 nixos kernel:  run_timer_softirq+0x1d/0x40
Oct 07 02:26:44 nixos kernel:  __do_softirq+0xc7/0x2ae
Oct 07 02:26:44 nixos kernel:  __irq_exit_rcu+0x93/0xb0
Oct 07 02:26:44 nixos kernel:  sysvec_apic_timer_interrupt+0x72/0x90
Oct 07 02:26:44 nixos kernel:  </IRQ>
Oct 07 02:26:44 nixos kernel:  <TASK>
Oct 07 02:26:44 nixos kernel:  asm_sysvec_apic_timer_interrupt+0x1a/0x20
Oct 07 02:26:44 nixos kernel: RIP: 0010:cpuidle_enter_state+0xcc/0x440
Oct 07 02:26:44 nixos kernel: Code: ca 8d 63 ff e8 25 f2 ff ff 8b 53 04 49 89 c5 0f 1f 44 00 00 31 ff e8 43 a3 62 ff 45 84 ff 0f 85 57 02 00 00 fb 0f 1f 44 00 00 <45> 85 f6 0f 88 85 01 00 00 49 63 d6 48 8d 04 52 48 8d 04 82 49 8d
Oct 07 02:26:44 nixos kernel: RSP: 0018:ffff9c13001cfe90 EFLAGS: 00000246
Oct 07 02:26:44 nixos kernel: RAX: ffff920ef8832840 RBX: ffff9207c3aba800 RCX: 000000000000001f
Oct 07 02:26:44 nixos kernel: RDX: 0000000000000008 RSI: 000000001b490a12 RDI: 0000000000000000
Oct 07 02:26:44 nixos kernel: RBP: 0000000000000001 R08: 0000000000000002 R09: ffff920ef8831344
Oct 07 02:26:44 nixos kernel: R10: 00000000000001c3 R11: 000000000000003c R12: ffffffffa51b1440
Oct 07 02:26:44 nixos kernel: R13: 000029482a95026d R14: 0000000000000001 R15: 0000000000000000
Oct 07 02:26:44 nixos kernel:  cpuidle_enter+0x2d/0x40
Oct 07 02:26:44 nixos kernel:  do_idle+0x1d8/0x230
Oct 07 02:26:44 nixos kernel:  cpu_startup_entry+0x1d/0x20
Oct 07 02:26:44 nixos kernel:  start_secondary+0x11e/0x140
Oct 07 02:26:44 nixos kernel:  secondary_startup_64_no_verify+0x17e/0x18b
Oct 07 02:26:44 nixos kernel:  </TASK>
Oct 07 02:27:48 nixos kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
Oct 07 02:27:48 nixos kernel: rcu:         8-....: (386 ticks this GP) idle=ecec/1/0x4000000000000002 softirq=856848/856848 fqs=19835
Oct 07 02:27:48 nixos kernel: rcu:         (detected by 7, t=84187 jiffies, g=5095313, q=10412 ncpus=12)
```
Comment 1 chris 2023-10-29 17:12:49 UTC
So far I have a system crash every other day, I'm trying the hack below to see if that helps:

I'm adding `boot.extraModprobeConfig = "options iwlmvm power_scheme=1";` to `configuration.nix`, then `sudo nixos-rebuild switch`, and reboot.

Hack suggested in https://wiki.debian.org/iwlwifi.

I have no clue if it's relevant or not.
Comment 2 chris 2023-11-04 01:51:37 UTC
I was hoping it would help, but it didn't.
Just checking the boot option is taken into account:
```
$ cat /sys/module/iwlmvm/parameters/power_scheme 
1
```
It is.
Here the latest occurrence of our usual crash:
```
$ journalctl -b -1 | sed -n '/iwlwifi .* Queue .* is stuck/,$p'
Nov 04 01:20:25 nixos kernel: iwlwifi 0000:08:00.0: Queue 4 is stuck 38515 38582
Nov 04 01:20:40 nixos kwin_wayland_wrapper[1159]: This plugin does not support raise()
Nov 04 01:20:46 nixos kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
Nov 04 01:20:46 nixos kernel: rcu:         4-....: (3 GPs behind) idle=7174/1/0x4000000000000002 softirq=1005972/1005973 fqs=4839
Nov 04 01:20:46 nixos kernel: rcu:         (detected by 0, t=21002 jiffies, g=5754421, q=12701 ncpus=12)
Nov 04 01:20:46 nixos kernel: Sending NMI from CPU 0 to CPUs 4:
Nov 04 01:20:46 nixos kernel: NMI backtrace for cpu 4
Nov 04 01:20:46 nixos kernel: CPU: 4 PID: 0 Comm: swapper/4 Not tainted 6.5.2 #1-NixOS
Nov 04 01:20:46 nixos kernel: Hardware name: ASUS System Product Name/ROG STRIX X670E-E GAMING WIFI, BIOS 1602 08/15/2023
Nov 04 01:20:46 nixos kernel: RIP: 0010:iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Nov 04 01:20:46 nixos kernel: Code: 1f 80 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 0f 1f 44 00 00 89 f6 48 03 b7 30 35 00 00 8b 06 <e9> 97 5a df ce 0f 1f 80 00 00 00 00 90 90 90 90 90 90 90 90 90 90
Nov 04 01:20:46 nixos kernel: RSP: 0018:ffffaddb802c0df8 EFLAGS: 00000286
Nov 04 01:20:46 nixos kernel: RAX: 00000000ffffffff RBX: ffffa05e10974028 RCX: 0000000000000004
Nov 04 01:20:46 nixos kernel: RDX: 00000000000005b1 RSI: ffffaddb80f54024 RDI: ffffa05e10974028
Nov 04 01:20:46 nixos kernel: RBP: 0000000000000011 R08: 0000000000003a98 R09: ffffaddb802c0be0
Nov 04 01:20:46 nixos kernel: R10: 0000000000000003 R11: ffffffff91138788 R12: 0000000000000024
Nov 04 01:20:46 nixos kernel: R13: 0000000000000024 R14: ffffa05e10974028 R15: 0000000000003a98
Nov 04 01:20:46 nixos kernel: FS:  0000000000000000(0000) GS:ffffa06538700000(0000) knlGS:0000000000000000
Nov 04 01:20:46 nixos kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Nov 04 01:20:46 nixos kernel: CR2: 00007f84a64abff0 CR3: 0000000111772000 CR4: 0000000000750ee0
Nov 04 01:20:46 nixos kernel: PKRU: 55555554
Nov 04 01:20:46 nixos kernel: Call Trace:
Nov 04 01:20:46 nixos kernel:  <NMI>
Nov 04 01:20:46 nixos kernel:  ? nmi_cpu_backtrace+0x99/0x110
Nov 04 01:20:46 nixos kernel:  ? nmi_cpu_backtrace_handler+0x11/0x20
Nov 04 01:20:46 nixos kernel:  ? nmi_handle+0x5e/0x150
Nov 04 01:20:46 nixos kernel:  ? default_do_nmi+0x40/0x100
Nov 04 01:20:46 nixos kernel:  ? exc_nmi+0x139/0x1c0
Nov 04 01:20:46 nixos kernel:  ? end_repeat_nmi+0x16/0x67
Nov 04 01:20:46 nixos kernel:  ? iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Nov 04 01:20:46 nixos kernel:  ? iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Nov 04 01:20:46 nixos kernel:  ? iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Nov 04 01:20:46 nixos kernel:  </NMI>
Nov 04 01:20:46 nixos kernel:  <IRQ>
Nov 04 01:20:46 nixos kernel:  iwl_read32+0x20/0x80 [iwlwifi]
Nov 04 01:20:46 nixos kernel:  iwl_poll_bit+0x42/0x70 [iwlwifi]
Nov 04 01:20:46 nixos kernel:  __iwl_trans_pcie_grab_nic_access+0xb7/0x150 [iwlwifi]
Nov 04 01:20:46 nixos kernel:  ? __pfx_iwl_txq_stuck_timer+0x10/0x10 [iwlwifi]
Nov 04 01:20:46 nixos kernel:  iwl_trans_pcie_grab_nic_access+0x1a/0x40 [iwlwifi]
Nov 04 01:20:46 nixos kernel:  iwl_force_nmi+0xc8/0xe0 [iwlwifi]
Nov 04 01:20:46 nixos kernel:  call_timer_fn+0x24/0x130
Nov 04 01:20:46 nixos kernel:  ? __pfx_iwl_txq_stuck_timer+0x10/0x10 [iwlwifi]
Nov 04 01:20:46 nixos kernel:  __run_timers+0x222/0x2c0
Nov 04 01:20:46 nixos kernel:  run_timer_softirq+0x1d/0x40
Nov 04 01:20:46 nixos kernel:  __do_softirq+0xc7/0x2ae
Nov 04 01:20:46 nixos kernel:  __irq_exit_rcu+0x93/0xb0
Nov 04 01:20:46 nixos kernel:  sysvec_apic_timer_interrupt+0x72/0x90
Nov 04 01:20:46 nixos kernel:  </IRQ>
Nov 04 01:20:46 nixos kernel:  <TASK>
Nov 04 01:20:46 nixos kernel:  asm_sysvec_apic_timer_interrupt+0x1a/0x20
Nov 04 01:20:46 nixos kernel: RIP: 0010:cpuidle_enter_state+0xcc/0x440
Nov 04 01:20:46 nixos kernel: Code: ca 8d 63 ff e8 25 f2 ff ff 8b 53 04 49 89 c5 0f 1f 44 00 00 31 ff e8 43 a3 62 ff 45 84 ff 0f 85 57 02 00 00 fb 0f 1f 44 00 00 <45> 85 f6 0f 88 85 01 00 00 49 63 d6 48 8d 04 52 48 8d 04 82 49 8d
Nov 04 01:20:46 nixos kernel: RSP: 0018:ffffaddb801afe90 EFLAGS: 00000246
Nov 04 01:20:46 nixos kernel: RAX: ffffa06538732840 RBX: ffffa05e03ae6000 RCX: 000000000000001f
Nov 04 01:20:46 nixos kernel: RDX: 0000000000000004 RSI: 000000001b490b36 RDI: 0000000000000000
Nov 04 01:20:46 nixos kernel: RBP: 0000000000000002 R08: 0000000000000002 R09: ffffa06538731344
Nov 04 01:20:46 nixos kernel: R10: 0000000000000018 R11: 00000000000006d1 R12: ffffffff911b1440
Nov 04 01:20:46 nixos kernel: R13: 00001d993e993b51 R14: 0000000000000002 R15: 0000000000000000
Nov 04 01:20:46 nixos kernel:  cpuidle_enter+0x2d/0x40
Nov 04 01:20:46 nixos kernel:  do_idle+0x1d8/0x230
Nov 04 01:20:46 nixos kernel:  cpu_startup_entry+0x1d/0x20
Nov 04 01:20:46 nixos kernel:  start_secondary+0x11e/0x140
Nov 04 01:20:46 nixos kernel:  secondary_startup_64_no_verify+0x17e/0x18b
Nov 04 01:20:46 nixos kernel:  </TASK>
Nov 04 01:20:46 nixos wireplumber[1380]: 0x24216d0: (0 missed) out of buffers on port 0 2
Nov 04 01:20:53 nixos kwin_wayland_wrapper[1159]: This plugin does not support raise()
Nov 04 01:20:56 nixos .firefox-wrappe[20108]: Unable to load hand2 from the cursor theme
Nov 04 01:21:00 nixos .firefox-wrappe[20108]: Unable to load hand2 from the cursor theme
Nov 04 01:21:01 nixos bluetoothd[960]: profiles/audio/avdtp.c:cancel_request() Suspend: Connection timed out (110)
Nov 04 01:21:02 nixos kwin_wayland_wrapper[1159]: This plugin does not support raise()
Nov 04 01:21:11 nixos bluetoothd[960]: profiles/audio/avdtp.c:cancel_request() Suspend: Connection timed out (110)
Nov 04 01:21:13 nixos bluetoothd[960]: profiles/audio/avdtp.c:cancel_request() Abort: Connection timed out (110)
Nov 04 01:21:13 nixos dbus-daemon[995]: [system] Rejected send message, 0 matched rules; type="method_return", sender=":1.43" (uid=1001 pid=1380 comm="/nix/store/5dv1drbz53fzb0k6r7rawlsn91g5xw9l-wirepl" label="kernel") interface="(unset)" member="(unset)" error name="(unset)" requested_reply="0" destination=":1.5" (uid=0 pid=960 comm="/nix/store/d4prbdwx8k1hw47harhdg2j16glnzzd2-bluez-" label="kernel")
Nov 04 01:21:13 nixos kdeconnectd[1410]: org.kde.pulseaudio: No object for name "bluez_output.E4_22_A5_E6_95_D1.1"
Nov 04 01:21:13 nixos kdeconnectd[1410]: org.kde.pulseaudio: No object for name "bluez_output.E4_22_A5_E6_95_D1.1.monitor"
Nov 04 01:21:13 nixos kdeconnectd[1410]: org.kde.pulseaudio: No object for name "alsa_output.usb-Generic_USB_Audio-00.HiFi__hw_Audio_2__sink.monitor"
Nov 04 01:21:13 nixos plasmashell[1287]: org.kde.plasma.pulseaudio: No object for name "bluez_output.E4_22_A5_E6_95_D1.1"
Nov 04 01:21:13 nixos plasmashell[1287]: org.kde.plasma.pulseaudio: No object for name "bluez_output.E4_22_A5_E6_95_D1.1.monitor"
Nov 04 01:21:13 nixos plasmashell[1287]: file:///nix/store/xfiq9gl8gwr26bnq1bvdg5lvgqqacxwn-plasma-pa-5.27.8/share/plasma/plasmoids/org.kde.plasma.volume/contents/ui/ListItemBase.qml:119: TypeError: Value is undefined and could not be converted to an object
Nov 04 01:21:13 nixos plasmashell[1287]: org.kde.plasma.pulseaudio: No object for name "alsa_output.usb-Generic_USB_Audio-00.HiFi__hw_Audio_2__sink.monitor"
Nov 04 01:21:13 nixos plasmashell[1287]: org.kde.plasma.pulseaudio: No object for name "alsa_output.usb-Generic_USB_Audio-00.HiFi__hw_Audio_2__sink.monitor"
Nov 04 01:21:33 nixos wireplumber[1380]: failed to switch codec (-5), setting fallback profile
Nov 04 01:21:33 nixos kdeconnectd[1410]: org.kde.pulseaudio: No object for name "alsa_output.usb-Generic_USB_Audio-00.HiFi__hw_Audio_2__sink.monitor"
Nov 04 01:21:33 nixos kdeconnectd[1410]: org.kde.pulseaudio: No object for name "alsa_output.usb-Generic_USB_Audio-00.HiFi__hw_Audio_2__sink.monitor"
Nov 04 01:21:34 nixos plasmashell[1287]: org.kde.plasma.pulseaudio: No object for name "alsa_output.usb-Generic_USB_Audio-00.HiFi__hw_Audio_2__sink.monitor"
Nov 04 01:21:34 nixos plasmashell[1287]: org.kde.plasma.pulseaudio: No object for name "alsa_output.usb-Generic_USB_Audio-00.HiFi__hw_Audio_2__sink.monitor"
Nov 04 01:21:41 nixos kwin_wayland_wrapper[1159]: This plugin does not support raise()
Nov 04 01:21:41 nixos .firefox-wrappe[20108]: Unable to load hand2 from the cursor theme
Nov 04 01:21:49 nixos kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
Nov 04 01:21:49 nixos kernel: rcu:         4-....: (3 GPs behind) idle=7174/1/0x4000000000000002 softirq=1005972/1005973 fqs=24404
Nov 04 01:21:49 nixos kernel: rcu:         (detected by 0, t=84183 jiffies, g=5754421, q=207748 ncpus=12)
Nov 04 01:21:49 nixos kernel: Sending NMI from CPU 0 to CPUs 4:
Nov 04 01:21:49 nixos kernel: NMI backtrace for cpu 4
Nov 04 01:21:49 nixos kernel: CPU: 4 PID: 0 Comm: swapper/4 Not tainted 6.5.2 #1-NixOS
Nov 04 01:21:49 nixos kernel: Hardware name: ASUS System Product Name/ROG STRIX X670E-E GAMING WIFI, BIOS 1602 08/15/2023
Nov 04 01:21:49 nixos kernel: RIP: 0010:iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Nov 04 01:21:49 nixos kernel: Code: 1f 80 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 0f 1f 44 00 00 89 f6 48 03 b7 30 35 00 00 8b 06 <e9> 97 5a df ce 0f 1f 80 00 00 00 00 90 90 90 90 90 90 90 90 90 90
Nov 04 01:21:49 nixos kernel: RSP: 0018:ffffaddb802c0df8 EFLAGS: 00000286
Nov 04 01:21:49 nixos kernel: RAX: 00000000ffffffff RBX: ffffa05e10974028 RCX: 0000000000000004
Nov 04 01:21:49 nixos kernel: RDX: 000000000000060f RSI: ffffaddb80f54024 RDI: ffffa05e10974028
Nov 04 01:21:49 nixos kernel: RBP: 0000000000000011 R08: 0000000000003a98 R09: ffffaddb802c0be0
Nov 04 01:21:49 nixos kernel: R10: 0000000000000003 R11: ffffffff91138788 R12: 0000000000000024
Nov 04 01:21:49 nixos kernel: R13: 0000000000000024 R14: ffffa05e10974028 R15: 0000000000003a98
Nov 04 01:21:49 nixos kernel: FS:  0000000000000000(0000) GS:ffffa06538700000(0000) knlGS:0000000000000000
Nov 04 01:21:49 nixos kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Nov 04 01:21:49 nixos kernel: CR2: 00007f84a64abff0 CR3: 0000000111772000 CR4: 0000000000750ee0
Nov 04 01:21:49 nixos kernel: PKRU: 55555554
Nov 04 01:21:49 nixos kernel: Call Trace:
Nov 04 01:21:49 nixos kernel:  <NMI>
Nov 04 01:21:49 nixos kernel:  ? nmi_cpu_backtrace+0x99/0x110
Nov 04 01:21:49 nixos kernel:  ? nmi_cpu_backtrace_handler+0x11/0x20
Nov 04 01:21:49 nixos kernel:  ? nmi_handle+0x5e/0x150
Nov 04 01:21:49 nixos kernel:  ? default_do_nmi+0x40/0x100
Nov 04 01:21:49 nixos kernel:  ? exc_nmi+0x139/0x1c0
Nov 04 01:21:49 nixos kernel:  ? end_repeat_nmi+0x16/0x67
Nov 04 01:21:49 nixos kernel:  ? iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Nov 04 01:21:49 nixos kernel:  ? iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Nov 04 01:21:49 nixos kernel:  ? iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Nov 04 01:21:49 nixos kernel:  </NMI>
Nov 04 01:21:49 nixos kernel:  <IRQ>
Nov 04 01:21:49 nixos kernel:  iwl_read32+0x20/0x80 [iwlwifi]
Nov 04 01:21:49 nixos kernel:  iwl_poll_bit+0x42/0x70 [iwlwifi]
Nov 04 01:21:49 nixos kernel:  __iwl_trans_pcie_grab_nic_access+0xb7/0x150 [iwlwifi]
Nov 04 01:21:49 nixos kernel:  ? __pfx_iwl_txq_stuck_timer+0x10/0x10 [iwlwifi]
Nov 04 01:21:49 nixos kernel:  iwl_trans_pcie_grab_nic_access+0x1a/0x40 [iwlwifi]
Nov 04 01:21:49 nixos kernel:  iwl_force_nmi+0xc8/0xe0 [iwlwifi]
Nov 04 01:21:49 nixos kernel:  call_timer_fn+0x24/0x130
Nov 04 01:21:49 nixos kernel:  ? __pfx_iwl_txq_stuck_timer+0x10/0x10 [iwlwifi]
Nov 04 01:21:49 nixos kernel:  __run_timers+0x222/0x2c0
Nov 04 01:21:49 nixos kernel:  run_timer_softirq+0x1d/0x40
Nov 04 01:21:49 nixos kernel:  __do_softirq+0xc7/0x2ae
Nov 04 01:21:49 nixos kernel:  __irq_exit_rcu+0x93/0xb0
Nov 04 01:21:49 nixos kernel:  sysvec_apic_timer_interrupt+0x72/0x90
Nov 04 01:21:49 nixos kernel:  </IRQ>
Nov 04 01:21:49 nixos kernel:  <TASK>
Nov 04 01:21:49 nixos kernel:  asm_sysvec_apic_timer_interrupt+0x1a/0x20
Nov 04 01:21:49 nixos kernel: RIP: 0010:cpuidle_enter_state+0xcc/0x440
Nov 04 01:21:49 nixos kernel: Code: ca 8d 63 ff e8 25 f2 ff ff 8b 53 04 49 89 c5 0f 1f 44 00 00 31 ff e8 43 a3 62 ff 45 84 ff 0f 85 57 02 00 00 fb 0f 1f 44 00 00 <45> 85 f6 0f 88 85 01 00 00 49 63 d6 48 8d 04 52 48 8d 04 82 49 8d
Nov 04 01:21:49 nixos kernel: RSP: 0018:ffffaddb801afe90 EFLAGS: 00000246
Nov 04 01:21:49 nixos kernel: RAX: ffffa06538732840 RBX: ffffa05e03ae6000 RCX: 000000000000001f
Nov 04 01:21:49 nixos kernel: RDX: 0000000000000004 RSI: 000000001b490b36 RDI: 0000000000000000
Nov 04 01:21:49 nixos kernel: RBP: 0000000000000002 R08: 0000000000000002 R09: ffffa06538731344
Nov 04 01:21:49 nixos kernel: R10: 0000000000000018 R11: 00000000000006d1 R12: ffffffff911b1440
Nov 04 01:21:49 nixos kernel: R13: 00001d993e993b51 R14: 0000000000000002 R15: 0000000000000000
Nov 04 01:21:49 nixos kernel:  cpuidle_enter+0x2d/0x40
Nov 04 01:21:49 nixos kernel:  do_idle+0x1d8/0x230
Nov 04 01:21:49 nixos kernel:  cpu_startup_entry+0x1d/0x20
Nov 04 01:21:49 nixos kernel:  start_secondary+0x11e/0x140
Nov 04 01:21:49 nixos kernel:  secondary_startup_64_no_verify+0x17e/0x18b
Nov 04 01:21:49 nixos kernel:  </TASK>
Nov 04 01:21:55 nixos kernel: pcieport 0000:06:08.0: Unable to change power state from D3hot to D0, device inaccessible
Nov 04 01:22:49 nixos plasmashell[20108]: [89B blob data]
Nov 04 01:22:49 nixos plasmashell[20108]: ExceptionHandler::GenerateDump cloned child 22033
Nov 04 01:22:49 nixos plasmashell[20108]: ExceptionHandler::SendContinueSignalToChild sent continue signal to child
Nov 04 01:22:49 nixos plasmashell[22033]: ExceptionHandler::WaitForContinueSignal waiting for continue signal...
Nov 04 01:22:53 nixos kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
Nov 04 01:22:53 nixos kernel: rcu:         4-....: (3 GPs behind) idle=7174/1/0x4000000000000002 softirq=1005972/1005973 fqs=26349
Nov 04 01:22:53 nixos kernel: rcu:         (detected by 6, t=147446 jiffies, g=5754421, q=212303 ncpus=12)
Nov 04 01:22:53 nixos kernel: Sending NMI from CPU 6 to CPUs 4:
Nov 04 01:22:53 nixos kernel: NMI backtrace for cpu 4
Nov 04 01:22:53 nixos kernel: CPU: 4 PID: 0 Comm: swapper/4 Not tainted 6.5.2 #1-NixOS
Nov 04 01:22:53 nixos kernel: Hardware name: ASUS System Product Name/ROG STRIX X670E-E GAMING WIFI, BIOS 1602 08/15/2023
Nov 04 01:22:53 nixos kernel: RIP: 0010:iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Nov 04 01:22:53 nixos kernel: Code: 1f 80 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 0f 1f 44 00 00 89 f6 48 03 b7 30 35 00 00 8b 06 <e9> 97 5a df ce 0f 1f 80 00 00 00 00 90 90 90 90 90 90 90 90 90 90
Nov 04 01:22:53 nixos kernel: RSP: 0018:ffffaddb802c0df8 EFLAGS: 00000286
Nov 04 01:22:53 nixos kernel: RAX: 00000000ffffffff RBX: ffffa05e10974028 RCX: 0000000000000004
Nov 04 01:22:53 nixos kernel: RDX: 000000000000060f RSI: ffffaddb80f54024 RDI: ffffa05e10974028
Nov 04 01:22:53 nixos kernel: RBP: 0000000000000011 R08: 0000000000003a98 R09: ffffaddb802c0be0
Nov 04 01:22:53 nixos kernel: R10: 0000000000000003 R11: ffffffff91138788 R12: 0000000000000024
Nov 04 01:22:53 nixos kernel: R13: 0000000000000024 R14: ffffa05e10974028 R15: 0000000000003a98
Nov 04 01:22:53 nixos kernel: FS:  0000000000000000(0000) GS:ffffa06538700000(0000) knlGS:0000000000000000
Nov 04 01:22:53 nixos kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Nov 04 01:22:53 nixos kernel: CR2: 00007f84a64abff0 CR3: 0000000111772000 CR4: 0000000000750ee0
Nov 04 01:22:53 nixos kernel: PKRU: 55555554
Nov 04 01:22:53 nixos kernel: Call Trace:
Nov 04 01:22:53 nixos kernel:  <NMI>
Nov 04 01:22:53 nixos kernel:  ? nmi_cpu_backtrace+0x99/0x110
Nov 04 01:22:53 nixos kernel:  ? nmi_cpu_backtrace_handler+0x11/0x20
Nov 04 01:22:53 nixos kernel:  ? nmi_handle+0x5e/0x150
Nov 04 01:22:53 nixos kernel:  ? default_do_nmi+0x40/0x100
Nov 04 01:22:53 nixos kernel:  ? exc_nmi+0x139/0x1c0
Nov 04 01:22:53 nixos kernel:  ? end_repeat_nmi+0x16/0x67
Nov 04 01:22:53 nixos kernel:  ? iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Nov 04 01:22:53 nixos kernel:  ? iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Nov 04 01:22:53 nixos kernel:  ? iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Nov 04 01:22:53 nixos kernel:  </NMI>
Nov 04 01:22:53 nixos kernel:  <IRQ>
Nov 04 01:22:53 nixos kernel:  iwl_read32+0x20/0x80 [iwlwifi]
Nov 04 01:22:53 nixos kernel:  iwl_poll_bit+0x42/0x70 [iwlwifi]
Nov 04 01:22:53 nixos kernel:  __iwl_trans_pcie_grab_nic_access+0xb7/0x150 [iwlwifi]
Nov 04 01:22:53 nixos kernel:  ? __pfx_iwl_txq_stuck_timer+0x10/0x10 [iwlwifi]
Nov 04 01:22:53 nixos kernel:  iwl_trans_pcie_grab_nic_access+0x1a/0x40 [iwlwifi]
Nov 04 01:22:53 nixos kernel:  iwl_force_nmi+0xc8/0xe0 [iwlwifi]
Nov 04 01:22:53 nixos kernel:  call_timer_fn+0x24/0x130
Nov 04 01:22:53 nixos kernel:  ? __pfx_iwl_txq_stuck_timer+0x10/0x10 [iwlwifi]
Nov 04 01:22:53 nixos kernel:  __run_timers+0x222/0x2c0
Nov 04 01:22:53 nixos kernel:  run_timer_softirq+0x1d/0x40
Nov 04 01:22:53 nixos kernel:  __do_softirq+0xc7/0x2ae
Nov 04 01:22:53 nixos kernel:  __irq_exit_rcu+0x93/0xb0
Nov 04 01:22:53 nixos kernel:  sysvec_apic_timer_interrupt+0x72/0x90
Nov 04 01:22:53 nixos kernel:  </IRQ>
Nov 04 01:22:53 nixos kernel:  <TASK>
Nov 04 01:22:53 nixos kernel:  asm_sysvec_apic_timer_interrupt+0x1a/0x20
Nov 04 01:22:53 nixos kernel: RIP: 0010:cpuidle_enter_state+0xcc/0x440
Nov 04 01:22:53 nixos kernel: Code: ca 8d 63 ff e8 25 f2 ff ff 8b 53 04 49 89 c5 0f 1f 44 00 00 31 ff e8 43 a3 62 ff 45 84 ff 0f 85 57 02 00 00 fb 0f 1f 44 00 00 <45> 85 f6 0f 88 85 01 00 00 49 63 d6 48 8d 04 52 48 8d 04 82 49 8d
Nov 04 01:22:53 nixos kernel: RSP: 0018:ffffaddb801afe90 EFLAGS: 00000246
Nov 04 01:22:53 nixos kernel: RAX: ffffa06538732840 RBX: ffffa05e03ae6000 RCX: 000000000000001f
Nov 04 01:22:53 nixos kernel: RDX: 0000000000000004 RSI: 000000001b490b36 RDI: 0000000000000000
Nov 04 01:22:53 nixos kernel: RBP: 0000000000000002 R08: 0000000000000002 R09: ffffa06538731344
Nov 04 01:22:53 nixos kernel: R10: 0000000000000018 R11: 00000000000006d1 R12: ffffffff911b1440
Nov 04 01:22:53 nixos kernel: R13: 00001d993e993b51 R14: 0000000000000002 R15: 0000000000000000
Nov 04 01:22:53 nixos kernel:  cpuidle_enter+0x2d/0x40
Nov 04 01:22:53 nixos kernel:  do_idle+0x1d8/0x230
Nov 04 01:22:53 nixos kernel:  cpu_startup_entry+0x1d/0x20
Nov 04 01:22:53 nixos kernel:  start_secondary+0x11e/0x140
Nov 04 01:22:53 nixos kernel:  secondary_startup_64_no_verify+0x17e/0x18b
Nov 04 01:22:53 nixos kernel:  </TASK>
Nov 04 01:23:07 nixos nsncd[975]: Nov 04 01:23:07.904 ERRO error handling request, err: error during lookup: LookupError { kind: Again, err_num: -3, inner: Custom { kind: Other, error: "failed to lookup address information: Temporary failure in name resolution" } }, request_type: GETHOSTBYNAME, thread: worker_6
Nov 04 01:23:56 nixos kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
Nov 04 01:23:56 nixos kernel: rcu:         4-....: (3 GPs behind) idle=7174/1/0x4000000000000002 softirq=1005972/1005973 fqs=26635
Nov 04 01:23:56 nixos kernel: rcu:         (detected by 0, t=210764 jiffies, g=5754421, q=227244 ncpus=12)
Nov 04 01:23:56 nixos kernel: Sending NMI from CPU 0 to CPUs 4:
Nov 04 01:23:56 nixos kernel: NMI backtrace for cpu 4
Nov 04 01:23:56 nixos kernel: CPU: 4 PID: 0 Comm: swapper/4 Not tainted 6.5.2 #1-NixOS
Nov 04 01:23:56 nixos kernel: Hardware name: ASUS System Product Name/ROG STRIX X670E-E GAMING WIFI, BIOS 1602 08/15/2023
Nov 04 01:23:56 nixos kernel: RIP: 0010:iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Nov 04 01:23:56 nixos kernel: Code: 1f 80 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 0f 1f 44 00 00 89 f6 48 03 b7 30 35 00 00 8b 06 <e9> 97 5a df ce 0f 1f 80 00 00 00 00 90 90 90 90 90 90 90 90 90 90
Nov 04 01:23:56 nixos kernel: RSP: 0018:ffffaddb802c0df8 EFLAGS: 00000286
Nov 04 01:23:56 nixos kernel: RAX: 00000000ffffffff RBX: ffffa05e10974028 RCX: 0000000000000004
Nov 04 01:23:56 nixos kernel: RDX: 000000000000060f RSI: ffffaddb80f54024 RDI: ffffa05e10974028
Nov 04 01:23:56 nixos kernel: RBP: 0000000000000011 R08: 0000000000003a98 R09: ffffaddb802c0be0
Nov 04 01:23:56 nixos kernel: R10: 0000000000000003 R11: ffffffff91138788 R12: 0000000000000024
Nov 04 01:23:56 nixos kernel: R13: 0000000000000024 R14: ffffa05e10974028 R15: 0000000000003a98
Nov 04 01:23:56 nixos kernel: FS:  0000000000000000(0000) GS:ffffa06538700000(0000) knlGS:0000000000000000
Nov 04 01:23:56 nixos kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Nov 04 01:23:56 nixos kernel: CR2: 00007f84a64abff0 CR3: 0000000111772000 CR4: 0000000000750ee0
Nov 04 01:23:56 nixos kernel: PKRU: 55555554
Nov 04 01:23:56 nixos kernel: Call Trace:
Nov 04 01:23:56 nixos kernel:  <NMI>
Nov 04 01:23:56 nixos kernel:  ? nmi_cpu_backtrace+0x99/0x110
Nov 04 01:23:56 nixos kernel:  ? nmi_cpu_backtrace_handler+0x11/0x20
Nov 04 01:23:56 nixos kernel:  ? nmi_handle+0x5e/0x150
Nov 04 01:23:56 nixos kernel:  ? default_do_nmi+0x40/0x100
Nov 04 01:23:56 nixos kernel:  ? exc_nmi+0x139/0x1c0
Nov 04 01:23:56 nixos kernel:  ? end_repeat_nmi+0x16/0x67
Nov 04 01:23:56 nixos kernel:  ? iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Nov 04 01:23:56 nixos kernel:  ? iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Nov 04 01:23:56 nixos kernel:  ? iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Nov 04 01:23:56 nixos kernel:  </NMI>
Nov 04 01:23:56 nixos kernel:  <IRQ>
Nov 04 01:23:56 nixos kernel:  iwl_read32+0x20/0x80 [iwlwifi]
Nov 04 01:23:56 nixos kernel:  iwl_poll_bit+0x42/0x70 [iwlwifi]
Nov 04 01:23:56 nixos kernel:  __iwl_trans_pcie_grab_nic_access+0xb7/0x150 [iwlwifi]
Nov 04 01:23:56 nixos kernel:  ? __pfx_iwl_txq_stuck_timer+0x10/0x10 [iwlwifi]
Nov 04 01:23:56 nixos kernel:  iwl_trans_pcie_grab_nic_access+0x1a/0x40 [iwlwifi]
Nov 04 01:23:56 nixos kernel:  iwl_force_nmi+0xc8/0xe0 [iwlwifi]
Nov 04 01:23:56 nixos kernel:  call_timer_fn+0x24/0x130
Nov 04 01:23:56 nixos kernel:  ? __pfx_iwl_txq_stuck_timer+0x10/0x10 [iwlwifi]
Nov 04 01:23:56 nixos kernel:  __run_timers+0x222/0x2c0
Nov 04 01:23:56 nixos kernel:  run_timer_softirq+0x1d/0x40
Nov 04 01:23:56 nixos kernel:  __do_softirq+0xc7/0x2ae
Nov 04 01:23:56 nixos kernel:  __irq_exit_rcu+0x93/0xb0
Nov 04 01:23:56 nixos kernel:  sysvec_apic_timer_interrupt+0x72/0x90
Nov 04 01:23:56 nixos kernel:  </IRQ>
Nov 04 01:23:56 nixos kernel:  <TASK>
Nov 04 01:23:56 nixos kernel:  asm_sysvec_apic_timer_interrupt+0x1a/0x20
Nov 04 01:23:56 nixos kernel: RIP: 0010:cpuidle_enter_state+0xcc/0x440
Nov 04 01:23:56 nixos kernel: Code: ca 8d 63 ff e8 25 f2 ff ff 8b 53 04 49 89 c5 0f 1f 44 00 00 31 ff e8 43 a3 62 ff 45 84 ff 0f 85 57 02 00 00 fb 0f 1f 44 00 00 <45> 85 f6 0f 88 85 01 00 00 49 63 d6 48 8d 04 52 48 8d 04 82 49 8d
Nov 04 01:23:56 nixos kernel: RSP: 0018:ffffaddb801afe90 EFLAGS: 00000246
Nov 04 01:23:56 nixos kernel: RAX: ffffa06538732840 RBX: ffffa05e03ae6000 RCX: 000000000000001f
Nov 04 01:23:56 nixos kernel: RDX: 0000000000000004 RSI: 000000001b490b36 RDI: 0000000000000000
Nov 04 01:23:56 nixos kernel: RBP: 0000000000000002 R08: 0000000000000002 R09: ffffa06538731344
Nov 04 01:23:56 nixos kernel: R10: 0000000000000018 R11: 00000000000006d1 R12: ffffffff911b1440
Nov 04 01:23:56 nixos kernel: R13: 00001d993e993b51 R14: 0000000000000002 R15: 0000000000000000
Nov 04 01:23:56 nixos kernel:  cpuidle_enter+0x2d/0x40
Nov 04 01:23:56 nixos kernel:  do_idle+0x1d8/0x230
Nov 04 01:23:56 nixos kernel:  cpu_startup_entry+0x1d/0x20
Nov 04 01:23:56 nixos kernel:  start_secondary+0x11e/0x140
Nov 04 01:23:56 nixos kernel:  secondary_startup_64_no_verify+0x17e/0x18b
Nov 04 01:23:56 nixos kernel:  </TASK>
Nov 04 01:24:12 nixos org.freedesktop.Akonadi.Control[5137]: org.kde.pim.kimap: Connection to server lost  QAbstractSocket::HostNotFoundError
Nov 04 01:24:12 nixos org.freedesktop.Akonadi.Control[5143]: org.kde.pim.kimap: Connection to server lost  QAbstractSocket::HostNotFoundError
Nov 04 01:24:12 nixos org.freedesktop.Akonadi.Control[5138]: org.kde.pim.kimap: Connection to server lost  QAbstractSocket::HostNotFoundError
Nov 04 01:24:14 nixos org.freedesktop.Akonadi.Control[5142]: org.kde.pim.kimap: Connection to server lost  QAbstractSocket::HostNotFoundError
Nov 04 01:24:33 nixos plasmashell[21385]: Exiting due to channel error.
Nov 04 01:24:33 nixos plasmashell[21432]: Exiting due to channel error.
Nov 04 01:24:33 nixos plasmashell[21122]: Exiting due to channel error.
Nov 04 01:24:56 nixos kernel: INFO: task bluetoothd:960 blocked for more than 123 seconds.
Nov 04 01:24:57 nixos kernel:       Not tainted 6.5.2 #1-NixOS
Nov 04 01:24:57 nixos kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Nov 04 01:24:57 nixos kernel: task:bluetoothd      state:D stack:0     pid:960   ppid:1      flags:0x00000002
Nov 04 01:24:57 nixos kernel: Call Trace:
Nov 04 01:24:57 nixos kernel:  <TASK>
Nov 04 01:24:57 nixos kernel:  __schedule+0x388/0x1390
Nov 04 01:24:57 nixos kernel:  ? srso_alias_return_thunk+0x5/0x7f
Nov 04 01:24:57 nixos kernel:  ? sock_def_readable+0x42/0xc0
Nov 04 01:24:57 nixos kernel:  ? srso_alias_return_thunk+0x5/0x7f
Nov 04 01:24:57 nixos kernel:  ? unix_stream_sendmsg+0x5d5/0x690
Nov 04 01:24:57 nixos kernel:  schedule+0x5e/0xd0
Nov 04 01:24:57 nixos kernel:  schedule_timeout+0x151/0x160
Nov 04 01:24:57 nixos kernel:  wait_for_completion+0x8a/0x160
Nov 04 01:24:57 nixos kernel:  __wait_rcu_gp+0x12f/0x140
Nov 04 01:24:57 nixos kernel:  synchronize_rcu+0x133/0x150
Nov 04 01:24:57 nixos kernel:  ? __pfx_call_rcu_hurry+0x10/0x10
Nov 04 01:24:57 nixos kernel:  ? __pfx_wakeme_after_rcu+0x10/0x10
Nov 04 01:24:57 nixos kernel:  kbd_disconnect+0x1a/0x30
Nov 04 01:24:57 nixos kernel:  __input_unregister_device+0xaf/0x190
Nov 04 01:24:57 nixos kernel:  input_unregister_device+0x45/0x70
Nov 04 01:24:57 nixos kernel:  uinput_destroy_device+0xba/0xc0 [uinput]
Nov 04 01:24:57 nixos kernel:  uinput_ioctl_handler.isra.0+0x398/0x990 [uinput]
Nov 04 01:24:57 nixos kernel:  ? ioctl_has_perm.constprop.0.isra.0+0xda/0x130
Nov 04 01:24:57 nixos kernel:  __x64_sys_ioctl+0x94/0xd0
Nov 04 01:24:57 nixos kernel:  do_syscall_64+0x3b/0x90
Nov 04 01:24:57 nixos kernel:  entry_SYSCALL_64_after_hwframe+0x6e/0xd8
Nov 04 01:24:57 nixos kernel: RIP: 0033:0x7fc8268e129f
Nov 04 01:24:57 nixos kernel: RSP: 002b:00007fff4e463e70 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
Nov 04 01:24:57 nixos kernel: RAX: ffffffffffffffda RBX: 000056152350ee00 RCX: 00007fc8268e129f
Nov 04 01:24:57 nixos kernel: RDX: 0000000000000000 RSI: 0000000000005502 RDI: 000000000000002b
Nov 04 01:24:57 nixos kernel: RBP: 00007fff4e463ed0 R08: 0000000000000058 R09: 0000000000000000
Nov 04 01:24:57 nixos kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 0000561521fa4620
Nov 04 01:24:57 nixos kernel: R13: 00005615234ed2c0 R14: 0000000000000003 R15: 00005615234e33a0
Nov 04 01:24:57 nixos kernel:  </TASK>
Nov 04 01:24:57 nixos kernel: INFO: task kworker/9:2:12412 blocked for more than 123 seconds.
Nov 04 01:24:57 nixos kernel:       Not tainted 6.5.2 #1-NixOS
Nov 04 01:24:57 nixos kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Nov 04 01:24:57 nixos kernel: task:kworker/9:2     state:D stack:0     pid:12412 ppid:2      flags:0x00004000
Nov 04 01:24:57 nixos kernel: Workqueue: events free_ipc
Nov 04 01:24:57 nixos kernel: Call Trace:
Nov 04 01:24:57 nixos kernel:  <TASK>
Nov 04 01:24:57 nixos kernel:  __schedule+0x388/0x1390
Nov 04 01:24:57 nixos kernel:  ? update_load_avg+0x7e/0x780
Nov 04 01:24:57 nixos kernel:  ? srso_alias_return_thunk+0x5/0x7f
Nov 04 01:24:57 nixos kernel:  ? srso_alias_return_thunk+0x5/0x7f
Nov 04 01:24:57 nixos kernel:  schedule+0x5e/0xd0
Nov 04 01:24:57 nixos kernel:  schedule_timeout+0x151/0x160
Nov 04 01:24:57 nixos kernel:  wait_for_completion+0x8a/0x160
Nov 04 01:24:57 nixos kernel:  __wait_rcu_gp+0x12f/0x140
Nov 04 01:24:57 nixos kernel:  synchronize_rcu+0x133/0x150
Nov 04 01:24:57 nixos kernel:  ? __pfx_call_rcu_hurry+0x10/0x10
Nov 04 01:24:57 nixos kernel:  ? __pfx_wakeme_after_rcu+0x10/0x10
Nov 04 01:24:57 nixos kernel:  free_ipc+0x56/0x140
Nov 04 01:24:57 nixos kernel:  process_one_work+0x1df/0x3e0
Nov 04 01:24:57 nixos kernel:  worker_thread+0x51/0x390
Nov 04 01:24:57 nixos kernel:  ? __pfx_worker_thread+0x10/0x10
Nov 04 01:24:57 nixos kernel:  kthread+0xe5/0x120
Nov 04 01:24:57 nixos kernel:  ? __pfx_kthread+0x10/0x10
Nov 04 01:24:57 nixos kernel:  ret_from_fork+0x31/0x50
Nov 04 01:24:57 nixos kernel:  ? __pfx_kthread+0x10/0x10
Nov 04 01:24:57 nixos kernel:  ret_from_fork_asm+0x1b/0x30
Nov 04 01:24:57 nixos kernel:  </TASK>
Nov 04 01:24:57 nixos kernel: INFO: task kworker/u24:5:20389 blocked for more than 123 seconds.
Nov 04 01:24:57 nixos kernel:       Not tainted 6.5.2 #1-NixOS
Nov 04 01:24:57 nixos kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Nov 04 01:24:57 nixos kernel: task:kworker/u24:5   state:D stack:0     pid:20389 ppid:2      flags:0x00004000
Nov 04 01:24:57 nixos kernel: Workqueue: netns cleanup_net
Nov 04 01:24:57 nixos kernel: Call Trace:
Nov 04 01:24:57 nixos kernel:  <TASK>
Nov 04 01:24:57 nixos kernel:  __schedule+0x388/0x1390
Nov 04 01:24:57 nixos kernel:  ? load_balance+0x198/0xd60
Nov 04 01:24:57 nixos kernel:  ? srso_alias_return_thunk+0x5/0x7f
Nov 04 01:24:57 nixos kernel:  schedule+0x5e/0xd0
Nov 04 01:24:57 nixos kernel:  schedule_timeout+0x151/0x160
Nov 04 01:24:57 nixos kernel:  wait_for_completion+0x8a/0x160
Nov 04 01:24:57 nixos kernel:  __wait_rcu_gp+0x12f/0x140
Nov 04 01:24:57 nixos kernel:  synchronize_rcu+0x133/0x150
Nov 04 01:24:57 nixos kernel:  ? __pfx_call_rcu_hurry+0x10/0x10
Nov 04 01:24:57 nixos kernel:  ? __pfx_wakeme_after_rcu+0x10/0x10
Nov 04 01:24:57 nixos kernel:  cleanup_net+0x202/0x3b0
Nov 04 01:24:57 nixos kernel:  process_one_work+0x1df/0x3e0
Nov 04 01:24:57 nixos kernel:  worker_thread+0x51/0x390
Nov 04 01:24:57 nixos kernel:  ? __pfx_worker_thread+0x10/0x10
Nov 04 01:24:57 nixos kernel:  kthread+0xe5/0x120
Nov 04 01:24:57 nixos kernel:  ? __pfx_kthread+0x10/0x10
Nov 04 01:24:57 nixos kernel:  ret_from_fork+0x31/0x50
Nov 04 01:24:57 nixos kernel:  ? __pfx_kthread+0x10/0x10
Nov 04 01:24:57 nixos kernel:  ret_from_fork_asm+0x1b/0x30
Nov 04 01:24:57 nixos kernel:  </TASK>
Nov 04 01:24:57 nixos kernel: INFO: task kworker/u24:7:20474 blocked for more than 123 seconds.
Nov 04 01:24:57 nixos kernel:       Not tainted 6.5.2 #1-NixOS
Nov 04 01:24:57 nixos kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Nov 04 01:24:57 nixos kernel: task:kworker/u24:7   state:D stack:0     pid:20474 ppid:2      flags:0x00004000
Nov 04 01:24:57 nixos kernel: Workqueue: events_unbound idle_cull_fn
Nov 04 01:24:57 nixos kernel: Call Trace:
Nov 04 01:24:57 nixos kernel:  <TASK>
Nov 04 01:24:57 nixos kernel:  __schedule+0x388/0x1390
Nov 04 01:24:57 nixos kernel:  ? srso_alias_return_thunk+0x5/0x7f
Nov 04 01:24:57 nixos kernel:  ? psi_group_change+0x152/0x3d0
Nov 04 01:24:57 nixos kernel:  schedule+0x5e/0xd0
Nov 04 01:24:57 nixos kernel:  schedule_preempt_disabled+0x15/0x30
Nov 04 01:24:57 nixos kernel:  __mutex_lock.constprop.0+0x399/0x700
Nov 04 01:24:57 nixos kernel:  idle_cull_fn+0x41/0x100
Nov 04 01:24:57 nixos kernel:  process_one_work+0x1df/0x3e0
Nov 04 01:24:57 nixos kernel:  worker_thread+0x51/0x390
Nov 04 01:24:57 nixos kernel:  ? __pfx_worker_thread+0x10/0x10
Nov 04 01:24:57 nixos kernel:  kthread+0xe5/0x120
Nov 04 01:24:57 nixos kernel:  ? __pfx_kthread+0x10/0x10
Nov 04 01:24:57 nixos kernel:  ret_from_fork+0x31/0x50
Nov 04 01:24:57 nixos kernel:  ? __pfx_kthread+0x10/0x10
Nov 04 01:24:57 nixos kernel:  ret_from_fork_asm+0x1b/0x30
Nov 04 01:24:57 nixos kernel:  </TASK>
Nov 04 01:24:57 nixos kernel: INFO: task kworker/6:1:22029 blocked for more than 123 seconds.
Nov 04 01:24:57 nixos kernel:       Not tainted 6.5.2 #1-NixOS
Nov 04 01:24:57 nixos kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Nov 04 01:24:57 nixos kernel: task:kworker/6:1     state:D stack:0     pid:22029 ppid:2      flags:0x00004000
Nov 04 01:24:57 nixos kernel: Call Trace:
Nov 04 01:24:57 nixos kernel:  <TASK>
Nov 04 01:24:57 nixos kernel:  ? __pfx_worker_thread+0x10/0x10
Nov 04 01:24:57 nixos kernel:  __schedule+0x388/0x1390
Nov 04 01:24:57 nixos kernel:  ? check_preempt_curr+0x5e/0x70
Nov 04 01:24:57 nixos kernel:  ? ttwu_do_activate+0x6b/0x230
Nov 04 01:24:57 nixos kernel:  ? __pfx_worker_thread+0x10/0x10
Nov 04 01:24:57 nixos kernel:  schedule+0x5e/0xd0
Nov 04 01:24:57 nixos kernel:  schedule_preempt_disabled+0x15/0x30
Nov 04 01:24:57 nixos kernel:  kthread+0xa8/0x120
Nov 04 01:24:57 nixos kernel:  ? __pfx_kthread+0x10/0x10
Nov 04 01:24:57 nixos kernel:  ret_from_fork+0x31/0x50
Nov 04 01:24:57 nixos kernel:  ? __pfx_kthread+0x10/0x10
Nov 04 01:24:57 nixos kernel:  ret_from_fork_asm+0x1b/0x30
Nov 04 01:24:57 nixos kernel:  </TASK>
Nov 04 01:24:59 nixos kernel: rcu: INFO: rcu_preempt self-detected stall on CPU
Nov 04 01:24:59 nixos kernel: rcu:         4-....: (3 GPs behind) idle=7174/1/0x4000000000000004 softirq=1005972/1005973 fqs=26935
Nov 04 01:24:59 nixos kernel: rcu:         (t=274081 jiffies g=5754421 q=232374 ncpus=12)
Nov 04 01:24:59 nixos kernel: CPU: 4 PID: 0 Comm: swapper/4 Not tainted 6.5.2 #1-NixOS
Nov 04 01:24:59 nixos kernel: Hardware name: ASUS System Product Name/ROG STRIX X670E-E GAMING WIFI, BIOS 1602 08/15/2023
Nov 04 01:24:59 nixos kernel: RIP: 0010:iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Nov 04 01:24:59 nixos kernel: Code: 1f 80 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 0f 1f 44 00 00 89 f6 48 03 b7 30 35 00 00 8b 06 <e9> 97 5a df ce 0f 1f 80 00 00 00 00 90 90 90 90 90 90 90 90 90 90
Nov 04 01:24:59 nixos kernel: RSP: 0018:ffffaddb802c0df8 EFLAGS: 00000286
Nov 04 01:24:59 nixos kernel: RAX: 00000000ffffffff RBX: ffffa05e10974028 RCX: 0000000000000004
Nov 04 01:24:59 nixos kernel: RDX: 000000000000060f RSI: ffffaddb80f54024 RDI: ffffa05e10974028
Nov 04 01:24:59 nixos kernel: RBP: 0000000000000011 R08: 0000000000003a98 R09: ffffaddb802c0be0
Nov 04 01:24:59 nixos kernel: R10: 0000000000000003 R11: ffffffff91138788 R12: 0000000000000024
Nov 04 01:24:59 nixos kernel: R13: 0000000000000024 R14: ffffa05e10974028 R15: 0000000000003a98
Nov 04 01:24:59 nixos kernel: FS:  0000000000000000(0000) GS:ffffa06538700000(0000) knlGS:0000000000000000
Nov 04 01:24:59 nixos kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Nov 04 01:24:59 nixos kernel: CR2: 00007f84a64abff0 CR3: 0000000111772000 CR4: 0000000000750ee0
Nov 04 01:24:59 nixos kernel: PKRU: 55555554
Nov 04 01:24:59 nixos kernel: Call Trace:
Nov 04 01:24:59 nixos kernel:  <IRQ>
Nov 04 01:24:59 nixos kernel:  ? rcu_dump_cpu_stacks+0xc4/0x100
Nov 04 01:24:59 nixos kernel:  ? rcu_sched_clock_irq+0x4f2/0x1130
Nov 04 01:24:59 nixos kernel:  ? srso_alias_return_thunk+0x5/0x7f
Nov 04 01:24:59 nixos kernel:  ? __wake_up_common_lock+0x8f/0xd0
Nov 04 01:24:59 nixos kernel:  ? srso_alias_return_thunk+0x5/0x7f
Nov 04 01:24:59 nixos kernel:  ? srso_alias_return_thunk+0x5/0x7f
Nov 04 01:24:59 nixos kernel:  ? trigger_load_balance+0x73/0x390
Nov 04 01:24:59 nixos kernel:  ? srso_alias_return_thunk+0x5/0x7f
Nov 04 01:24:59 nixos kernel:  ? scheduler_tick+0xd7/0x2b0
Nov 04 01:24:59 nixos kernel:  ? update_process_times+0x74/0xb0
Nov 04 01:24:59 nixos kernel:  ? ktime_get+0x3c/0xa0
Nov 04 01:24:59 nixos kernel:  ? tick_sched_handle+0x33/0x50
Nov 04 01:24:59 nixos kernel:  ? tick_sched_timer+0x6f/0x90
Nov 04 01:24:59 nixos kernel:  ? __pfx_tick_sched_timer+0x10/0x10
Nov 04 01:24:59 nixos kernel:  ? __hrtimer_run_queues+0x10f/0x2b0
Nov 04 01:24:59 nixos kernel:  ? hrtimer_interrupt+0xf8/0x230
Nov 04 01:24:59 nixos kernel:  ? __sysvec_apic_timer_interrupt+0x5e/0x130
Nov 04 01:24:59 nixos kernel:  ? sysvec_apic_timer_interrupt+0x39/0x90
Nov 04 01:24:59 nixos kernel:  ? asm_sysvec_apic_timer_interrupt+0x1a/0x20
Nov 04 01:24:59 nixos kernel:  ? iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Nov 04 01:24:59 nixos kernel:  ? srso_alias_return_thunk+0x5/0x7f
Nov 04 01:24:59 nixos kernel:  iwl_read32+0x20/0x80 [iwlwifi]
Nov 04 01:24:59 nixos kernel:  iwl_poll_bit+0x42/0x70 [iwlwifi]
Nov 04 01:24:59 nixos kernel:  __iwl_trans_pcie_grab_nic_access+0xb7/0x150 [iwlwifi]
Nov 04 01:24:59 nixos kernel:  ? __pfx_iwl_txq_stuck_timer+0x10/0x10 [iwlwifi]
Nov 04 01:24:59 nixos kernel:  iwl_trans_pcie_grab_nic_access+0x1a/0x40 [iwlwifi]
Nov 04 01:24:59 nixos kernel:  iwl_force_nmi+0xc8/0xe0 [iwlwifi]
Nov 04 01:24:59 nixos kernel:  call_timer_fn+0x24/0x130
Nov 04 01:24:59 nixos kernel:  ? __pfx_iwl_txq_stuck_timer+0x10/0x10 [iwlwifi]
Nov 04 01:24:59 nixos kernel:  __run_timers+0x222/0x2c0
Nov 04 01:24:59 nixos kernel:  run_timer_softirq+0x1d/0x40
Nov 04 01:24:59 nixos kernel:  __do_softirq+0xc7/0x2ae
Nov 04 01:24:59 nixos kernel:  __irq_exit_rcu+0x93/0xb0
Nov 04 01:24:59 nixos kernel:  sysvec_apic_timer_interrupt+0x72/0x90
Nov 04 01:24:59 nixos kernel:  </IRQ>
Nov 04 01:24:59 nixos kernel:  <TASK>
Nov 04 01:24:59 nixos kernel:  asm_sysvec_apic_timer_interrupt+0x1a/0x20
Nov 04 01:24:59 nixos kernel: RIP: 0010:cpuidle_enter_state+0xcc/0x440
Nov 04 01:24:59 nixos kernel: Code: ca 8d 63 ff e8 25 f2 ff ff 8b 53 04 49 89 c5 0f 1f 44 00 00 31 ff e8 43 a3 62 ff 45 84 ff 0f 85 57 02 00 00 fb 0f 1f 44 00 00 <45> 85 f6 0f 88 85 01 00 00 49 63 d6 48 8d 04 52 48 8d 04 82 49 8d
Nov 04 01:24:59 nixos kernel: RSP: 0018:ffffaddb801afe90 EFLAGS: 00000246
Nov 04 01:24:59 nixos kernel: RAX: ffffa06538732840 RBX: ffffa05e03ae6000 RCX: 000000000000001f
Nov 04 01:24:59 nixos kernel: RDX: 0000000000000004 RSI: 000000001b490b36 RDI: 0000000000000000
Nov 04 01:24:59 nixos kernel: RBP: 0000000000000002 R08: 0000000000000002 R09: ffffa06538731344
Nov 04 01:24:59 nixos kernel: R10: 0000000000000018 R11: 00000000000006d1 R12: ffffffff911b1440
Nov 04 01:24:59 nixos kernel: R13: 00001d993e993b51 R14: 0000000000000002 R15: 0000000000000000
Nov 04 01:24:59 nixos kernel:  cpuidle_enter+0x2d/0x40
Nov 04 01:24:59 nixos kernel:  do_idle+0x1d8/0x230
Nov 04 01:24:59 nixos kernel:  cpu_startup_entry+0x1d/0x20
Nov 04 01:24:59 nixos kernel:  start_secondary+0x11e/0x140
Nov 04 01:24:59 nixos kernel:  secondary_startup_64_no_verify+0x17e/0x18b
Nov 04 01:24:59 nixos kernel:  </TASK>
Nov 04 01:25:03 nixos org.freedesktop.Akonadi.Control[5138]: org.kde.pim.kimap: Connection to server lost  QAbstractSocket::HostNotFoundError
Nov 04 01:25:03 nixos org.freedesktop.Akonadi.Control[5137]: org.kde.pim.kimap: Connection to server lost  QAbstractSocket::HostNotFoundError
Nov 04 01:25:03 nixos org.freedesktop.Akonadi.Control[5143]: org.kde.pim.kimap: Connection to server lost  QAbstractSocket::HostNotFoundError
Nov 04 01:25:06 nixos org.freedesktop.Akonadi.Control[5142]: org.kde.pim.kimap: Connection to server lost  QAbstractSocket::HostNotFoundError
Nov 04 01:25:23 nixos org.freedesktop.Akonadi.Control[5137]: org.kde.pim.kimap: Connection to server lost  QAbstractSocket::HostNotFoundError
Nov 04 01:25:23 nixos org.freedesktop.Akonadi.Control[5138]: org.kde.pim.kimap: Connection to server lost  QAbstractSocket::HostNotFoundError
Nov 04 01:25:24 nixos org.freedesktop.Akonadi.Control[5143]: org.kde.pim.kimap: Connection to server lost  QAbstractSocket::HostNotFoundError
Nov 04 01:25:27 nixos org.freedesktop.Akonadi.Control[5142]: org.kde.pim.kimap: Connection to server lost  QAbstractSocket::HostNotFoundError
Nov 04 01:26:03 nixos kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
Nov 04 01:26:03 nixos kernel: rcu:         4-....: (3 GPs behind) idle=7174/1/0x4000000000000002 softirq=1005972/1005973 fqs=27225
Nov 04 01:26:03 nixos kernel: rcu:         (detected by 10, t=337177 jiffies, g=5754421, q=235551 ncpus=12)
Nov 04 01:26:03 nixos kernel: Sending NMI from CPU 10 to CPUs 4:
Nov 04 01:26:03 nixos kernel: NMI backtrace for cpu 4
Nov 04 01:26:03 nixos kernel: CPU: 4 PID: 0 Comm: swapper/4 Not tainted 6.5.2 #1-NixOS
Nov 04 01:26:03 nixos kernel: Hardware name: ASUS System Product Name/ROG STRIX X670E-E GAMING WIFI, BIOS 1602 08/15/2023
Nov 04 01:26:03 nixos kernel: RIP: 0010:iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Nov 04 01:26:03 nixos kernel: Code: 1f 80 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 0f 1f 44 00 00 89 f6 48 03 b7 30 35 00 00 8b 06 <e9> 97 5a df ce 0f 1f 80 00 00 00 00 90 90 90 90 90 90 90 90 90 90
Nov 04 01:26:03 nixos kernel: RSP: 0018:ffffaddb802c0df8 EFLAGS: 00000286
Nov 04 01:26:03 nixos kernel: RAX: 00000000ffffffff RBX: ffffa05e10974028 RCX: 0000000000000004
Nov 04 01:26:03 nixos kernel: RDX: 000000000000060f RSI: ffffaddb80f54024 RDI: ffffa05e10974028
Nov 04 01:26:03 nixos kernel: RBP: 0000000000000011 R08: 0000000000003a98 R09: ffffaddb802c0be0
Nov 04 01:26:03 nixos kernel: R10: 0000000000000003 R11: ffffffff91138788 R12: 0000000000000024
Nov 04 01:26:03 nixos kernel: R13: 0000000000000024 R14: ffffa05e10974028 R15: 0000000000003a98
Nov 04 01:26:03 nixos kernel: FS:  0000000000000000(0000) GS:ffffa06538700000(0000) knlGS:0000000000000000
Nov 04 01:26:03 nixos kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Nov 04 01:26:03 nixos kernel: CR2: 00007f84a64abff0 CR3: 0000000111772000 CR4: 0000000000750ee0
Nov 04 01:26:03 nixos kernel: PKRU: 55555554
Nov 04 01:26:03 nixos kernel: Call Trace:
Nov 04 01:26:03 nixos kernel:  <NMI>
Nov 04 01:26:03 nixos kernel:  ? nmi_cpu_backtrace+0x99/0x110
Nov 04 01:26:03 nixos kernel:  ? nmi_cpu_backtrace_handler+0x11/0x20
Nov 04 01:26:03 nixos kernel:  ? nmi_handle+0x5e/0x150
Nov 04 01:26:03 nixos kernel:  ? default_do_nmi+0x40/0x100
Nov 04 01:26:03 nixos kernel:  ? exc_nmi+0x139/0x1c0
Nov 04 01:26:03 nixos kernel:  ? end_repeat_nmi+0x16/0x67
Nov 04 01:26:03 nixos kernel:  ? iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Nov 04 01:26:03 nixos kernel:  ? iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Nov 04 01:26:03 nixos kernel:  ? iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Nov 04 01:26:03 nixos kernel:  </NMI>
Nov 04 01:26:03 nixos kernel:  <IRQ>
Nov 04 01:26:03 nixos kernel:  iwl_read32+0x20/0x80 [iwlwifi]
Nov 04 01:26:03 nixos kernel:  iwl_poll_bit+0x42/0x70 [iwlwifi]
Nov 04 01:26:03 nixos kernel:  __iwl_trans_pcie_grab_nic_access+0xb7/0x150 [iwlwifi]
Nov 04 01:26:03 nixos kernel:  ? __pfx_iwl_txq_stuck_timer+0x10/0x10 [iwlwifi]
Nov 04 01:26:03 nixos kernel:  iwl_trans_pcie_grab_nic_access+0x1a/0x40 [iwlwifi]
Nov 04 01:26:03 nixos kernel:  iwl_force_nmi+0xc8/0xe0 [iwlwifi]
Nov 04 01:26:03 nixos kernel:  call_timer_fn+0x24/0x130
Nov 04 01:26:03 nixos kernel:  ? __pfx_iwl_txq_stuck_timer+0x10/0x10 [iwlwifi]
Nov 04 01:26:03 nixos kernel:  __run_timers+0x222/0x2c0
Nov 04 01:26:03 nixos kernel:  run_timer_softirq+0x1d/0x40
Nov 04 01:26:03 nixos kernel:  __do_softirq+0xc7/0x2ae
Nov 04 01:26:03 nixos kernel:  __irq_exit_rcu+0x93/0xb0
Nov 04 01:26:03 nixos kernel:  sysvec_apic_timer_interrupt+0x72/0x90
Nov 04 01:26:03 nixos kernel:  </IRQ>
Nov 04 01:26:03 nixos kernel:  <TASK>
Nov 04 01:26:03 nixos kernel:  asm_sysvec_apic_timer_interrupt+0x1a/0x20
Nov 04 01:26:03 nixos kernel: RIP: 0010:cpuidle_enter_state+0xcc/0x440
Nov 04 01:26:03 nixos kernel: Code: ca 8d 63 ff e8 25 f2 ff ff 8b 53 04 49 89 c5 0f 1f 44 00 00 31 ff e8 43 a3 62 ff 45 84 ff 0f 85 57 02 00 00 fb 0f 1f 44 00 00 <45> 85 f6 0f 88 85 01 00 00 49 63 d6 48 8d 04 52 48 8d 04 82 49 8d
Nov 04 01:26:03 nixos kernel: RSP: 0018:ffffaddb801afe90 EFLAGS: 00000246
Nov 04 01:26:03 nixos kernel: RAX: ffffa06538732840 RBX: ffffa05e03ae6000 RCX: 000000000000001f
Nov 04 01:26:03 nixos kernel: RDX: 0000000000000004 RSI: 000000001b490b36 RDI: 0000000000000000
Nov 04 01:26:03 nixos kernel: RBP: 0000000000000002 R08: 0000000000000002 R09: ffffa06538731344
Nov 04 01:26:03 nixos kernel: R10: 0000000000000018 R11: 00000000000006d1 R12: ffffffff911b1440
Nov 04 01:26:03 nixos kernel: R13: 00001d993e993b51 R14: 0000000000000002 R15: 0000000000000000
Nov 04 01:26:03 nixos kernel:  cpuidle_enter+0x2d/0x40
Nov 04 01:26:03 nixos kernel:  do_idle+0x1d8/0x230
Nov 04 01:26:03 nixos kernel:  cpu_startup_entry+0x1d/0x20
Nov 04 01:26:03 nixos kernel:  start_secondary+0x11e/0x140
Nov 04 01:26:03 nixos kernel:  secondary_startup_64_no_verify+0x17e/0x18b
Nov 04 01:26:03 nixos kernel:  </TASK>
```
Comment 3 chris 2023-11-13 05:16:36 UTC
My new kernel is Linux 6.6.0, if anything it makes things worse because it remains in limbo for an hour before spontaneously rebooting.
The crash frequency remains at every other day.
I haven't found a reproducible way to trigger it.
I'm switching from 5 GHz to 2.4 GHz, I'll see if it makes things better.

When comparing to other similar bugs, I don't have the message "Microcode SW error detected. Restarting", which might explain why the PC ends up with a system crash instead of a temporary slow down.
Comment 4 chris 2023-12-14 01:39:07 UTC
So, what's new?

1. Switching to 2.4 GHz didn't make any difference.

2. At some point I opened a new "discussion" there:
https://community.intel.com/t5/Wireless/AX210-system-crash-after-iwlwifi-Queue-stuck-error/m-p/1550753

After a few days I've been told so upgrade from kernel 6.6.2 to kernel 6.6.5

And that is seemingly making some difference. A few minutes back the following error has been logged in `systemctl`:

```
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: Queue 4 is stuck 27958 27984
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: Microcode SW error detected. Restarting 0x0.
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: Start IWL Error Log Dump:
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: Transport status: 0x0000004A, valid: 6
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: Loaded firmware version: 83.e8f84e98.0 ty-a0-gf-a0-83.ucode
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x00000084 | NMI_INTERRUPT_UNKNOWN       
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x00808210 | trm_hw_status0
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x00000000 | trm_hw_status1
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x004DC410 | branchlink2
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x004D233E | interruptlink1
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x004D233E | interruptlink2
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x0000C266 | data1
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x01000000 | data2
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x00000000 | data3
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0xB3C154FA | beacon time
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0xDA3BDB0C | tsf low
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x00000A08 | tsf hi
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x00000000 | time gp1
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x732CC217 | time gp2
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x00000001 | uCode revision type
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x00000053 | uCode version major
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0xE8F84E98 | uCode version minor
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x00000420 | hw version
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x00C80002 | board version
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x8080F400 | hcmd
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x24020000 | isr0
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x01000000 | isr1
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x48F0000A | isr2
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x00C3009C | isr3
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x00000000 | isr4
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x0434001C | last cmd Id
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x0000C266 | wait_event
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x00000080 | l2p_control
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x00010034 | l2p_duration
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x0000003F | l2p_mhvalid
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x00CE18B8 | l2p_addr_match
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x0000000B | lmpm_pmg_sel
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x00000000 | timestamp
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x00009078 | flow_handler
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: Start IWL Error Log Dump:
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: Transport status: 0x0000004A, valid: 7
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x20000066 | NMI_INTERRUPT_HOST
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x00000000 | umac branchlink1
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x8046DA58 | umac branchlink2
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x8048DF3E | umac interruptlink1
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x8048DF3E | umac interruptlink2
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x01000000 | umac data1
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x8048DF3E | umac data2
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x00000000 | umac data3
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x00000053 | umac major
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0xE8F84E98 | umac minor
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x732CC214 | frame pointer
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0xC0886258 | stack pointer
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x0010010C | last host cmd
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x00000400 | isr status reg
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: IML/ROM dump:
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x00000B03 | IML/ROM error/state
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x00008179 | IML/ROM data1
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x00000090 | IML/ROM WFPM_AUTH_KEY_0
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: Fseq Registers:
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x60000000 | FSEQ_ERROR_CODE
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x80440007 | FSEQ_TOP_INIT_VERSION
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x00080009 | FSEQ_CNVIO_INIT_VERSION
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x0000A652 | FSEQ_OTP_VERSION
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x00000002 | FSEQ_TOP_CONTENT_VERSION
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x4552414E | FSEQ_ALIVE_TOKEN
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x00400410 | FSEQ_CNVI_ID
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x00400410 | FSEQ_CNVR_ID
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x00400410 | CNVI_AUX_MISC_CHIP
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x00400410 | CNVR_AUX_MISC_CHIP
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x00009061 | CNVR_SCU_SD_REGS_SD_REG_DIG_DCDC_VTRIM
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x00000061 | CNVR_SCU_SD_REGS_SD_REG_ACTIVE_VDIG_MIRROR
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x00080009 | FSEQ_PREV_CNVIO_INIT_VERSION
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x00440007 | FSEQ_WIFI_FSEQ_VERSION
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x00440007 | FSEQ_BT_FSEQ_VERSION
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: 0x000000DC | FSEQ_CLASS_TP_VERSION
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: UMAC CURRENT PC: 0x8048da0c
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: LMAC1 CURRENT PC: 0xd0
Dec 14 00:58:37 nixos kernel: iwlwifi 0000:08:00.0: WRT: Collecting data: ini trigger 4 fired (delay=0ms).
Dec 14 00:58:37 nixos kernel: ieee80211 phy0: Hardware restart was requested
Dec 14 00:58:38 nixos kernel: iwlwifi 0000:08:00.0: WRT: Invalid buffer destination
Dec 14 00:58:38 nixos kernel: iwlwifi 0000:08:00.0: WFPM_UMAC_PD_NOTIFICATION: 0x20
Dec 14 00:58:38 nixos kernel: iwlwifi 0000:08:00.0: WFPM_LMAC2_PD_NOTIFICATION: 0x1f
Dec 14 00:58:38 nixos kernel: iwlwifi 0000:08:00.0: WFPM_AUTH_KEY_0: 0x90
Dec 14 00:58:38 nixos kernel: iwlwifi 0000:08:00.0: CNVI_SCU_SEQ_DATA_DW9: 0x0
```
So, on the one hand I still have the same `iwlwifi 0000:08:00.0: Queue 4 is stuck 27958 27984` as before, but on the other hand I now have `iwlwifi 0000:08:00.0: Microcode SW error detected. Restarting 0x0.`, instead of `rcu: INFO: rcu_preempt detected stalls on CPUs/tasks`, and possibly the system is not crashing any more.

I'll keep you informed on how things go, but it seems encouraging: even though there is the same initial error, it might be that it doesn't kill the computer anymore, but that the system can recover from the error.

To be confirmed.
Comment 5 chris 2023-12-17 03:06:39 UTC
So, apparently it manages to recover, sometimes, but not always:

```
Dec 17 02:00:08 nixos kernel: iwlwifi 0000:08:00.0: Queue 4 is stuck 15564 15577
Dec 17 02:00:29 nixos kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
Dec 17 02:00:29 nixos kernel: rcu:         1-....: (3 GPs behind) idle=1324/1/0x4000000000000002 softirq=69993/69993 fqs=5044
Dec 17 02:00:29 nixos kernel: rcu:         (detected by 11, t=21002 jiffies, g=261461, q=17405 ncpus=12)
Dec 17 02:00:29 nixos kernel: Sending NMI from CPU 11 to CPUs 1:
Dec 17 02:00:29 nixos kernel: NMI backtrace for cpu 1
Dec 17 02:00:29 nixos kernel: CPU: 1 PID: 0 Comm: swapper/1 Not tainted 6.6.5 #1-NixOS
Dec 17 02:00:29 nixos kernel: Hardware name: ASUS System Product Name/ROG STRIX X670E-E GAMING WIFI, BIOS 1602 08/15/2023
Dec 17 02:00:29 nixos kernel: RIP: 0010:iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Dec 17 02:00:29 nixos kernel: Code: 1f 80 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 0f 1f 44 00 00 89 f6 48 03 b7 48 35 00 00 8b 06 <e9> f7 ed 3a d6 0>
Dec 17 02:00:29 nixos kernel: RSP: 0018:ffffc9000022cdf8 EFLAGS: 00000286
Dec 17 02:00:29 nixos kernel: RAX: 00000000ffffffff RBX: ffff88811651c028 RCX: 0000000000000001
Dec 17 02:00:29 nixos kernel: RDX: 0000000000000c7c RSI: ffffc90000a64024 RDI: ffff88811651c028
Dec 17 02:00:29 nixos kernel: RBP: 0000000000000011 R08: 0000000000003a98 R09: ffffc9000022cbd8
Dec 17 02:00:29 nixos kernel: R10: 0000000000000003 R11: ffffffff98538ac8 R12: 0000000000000024
Dec 17 02:00:29 nixos kernel: R13: 0000000000000024 R14: ffff88811651c028 R15: 0000000000003a98
Dec 17 02:00:29 nixos kernel: FS:  0000000000000000(0000) GS:ffff888838480000(0000) knlGS:0000000000000000
Dec 17 02:00:29 nixos kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Dec 17 02:00:29 nixos kernel: CR2: 00000000010a7000 CR3: 0000000113358000 CR4: 0000000000f50ee0
Dec 17 02:00:29 nixos kernel: PKRU: 55555554
Dec 17 02:00:29 nixos kernel: Call Trace:
Dec 17 02:00:29 nixos kernel:  <NMI>
Dec 17 02:00:29 nixos kernel:  ? nmi_cpu_backtrace+0x99/0x110
Dec 17 02:00:29 nixos kernel:  ? nmi_cpu_backtrace_handler+0x11/0x20
Dec 17 02:00:29 nixos kernel:  ? nmi_handle+0x5e/0x150
Dec 17 02:00:29 nixos kernel:  ? default_do_nmi+0x40/0x100
Dec 17 02:00:29 nixos kernel:  ? exc_nmi+0x139/0x1c0
Dec 17 02:00:29 nixos kernel:  ? end_repeat_nmi+0x16/0x67
Dec 17 02:00:29 nixos kernel:  ? iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Dec 17 02:00:29 nixos kernel:  ? iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Dec 17 02:00:29 nixos kernel:  ? iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Dec 17 02:00:29 nixos kernel:  </NMI>
Dec 17 02:00:29 nixos kernel:  <IRQ>
Dec 17 02:00:29 nixos kernel:  iwl_read32+0x20/0x80 [iwlwifi]
Dec 17 02:00:29 nixos kernel:  iwl_poll_bit+0x42/0x70 [iwlwifi]
Dec 17 02:00:29 nixos kernel:  __iwl_trans_pcie_grab_nic_access+0xb7/0x150 [iwlwifi]
Dec 17 02:00:29 nixos kernel:  ? __pfx_iwl_txq_stuck_timer+0x10/0x10 [iwlwifi]
Dec 17 02:00:29 nixos kernel:  iwl_trans_pcie_grab_nic_access+0x1a/0x40 [iwlwifi]
Dec 17 02:00:29 nixos kernel:  iwl_force_nmi+0xc8/0xe0 [iwlwifi]
Dec 17 02:00:29 nixos kernel:  call_timer_fn+0x24/0x130
Dec 17 02:00:29 nixos kernel:  ? __pfx_iwl_txq_stuck_timer+0x10/0x10 [iwlwifi]
Dec 17 02:00:29 nixos kernel:  __run_timers+0x222/0x2c0
Dec 17 02:00:29 nixos kernel:  run_timer_softirq+0x1d/0x40
Dec 17 02:00:29 nixos kernel:  __do_softirq+0xc7/0x2ae
Dec 17 02:00:29 nixos kernel:  __irq_exit_rcu+0x93/0xb0
Dec 17 02:00:29 nixos kernel:  sysvec_apic_timer_interrupt+0x72/0x90
Dec 17 02:00:29 nixos kernel:  </IRQ>
Dec 17 02:00:29 nixos kernel:  <TASK>
Dec 17 02:00:29 nixos kernel:  asm_sysvec_apic_timer_interrupt+0x1a/0x20
Dec 17 02:00:29 nixos kernel: RIP: 0010:cpuidle_enter_state+0xcc/0x440
Dec 17 02:00:29 nixos kernel: Code: 2a 4c 61 ff e8 25 f2 ff ff 8b 53 04 49 89 c5 0f 1f 44 00 00 31 ff e8 63 5e 60 ff 45 84 ff 0f 85 57 02 00 00 fb 0f 1f 44 00 00 <45> 85 f6 0f 88 8>
Dec 17 02:00:29 nixos kernel: RSP: 0018:ffffc9000019fe90 EFLAGS: 00000246
Dec 17 02:00:29 nixos kernel: RAX: ffff8888384b2b80 RBX: ffff88810367a400 RCX: 000000000000001f
Dec 17 02:00:29 nixos kernel: RDX: 0000000000000001 RSI: 000000001b490cbd RDI: 0000000000000000
Dec 17 02:00:29 nixos kernel: RBP: 0000000000000002 R08: 0000000000000002 R09: 0000000000000804
Dec 17 02:00:29 nixos kernel: R10: 0000000000000018 R11: ffff8888384b1624 R12: ffffffff985b2280
Dec 17 02:00:29 nixos kernel: R13: 0000009bb4c1819e R14: 0000000000000002 R15: 0000000000000000
Dec 17 02:00:29 nixos kernel:  cpuidle_enter+0x2d/0x40
Dec 17 02:00:29 nixos kernel:  do_idle+0x1d8/0x230
Dec 17 02:00:29 nixos kernel:  cpu_startup_entry+0x2a/0x30
Dec 17 02:00:29 nixos kernel:  start_secondary+0x11e/0x140
Dec 17 02:00:29 nixos kernel:  secondary_startup_64_no_verify+0x17d/0x18b
Dec 17 02:00:29 nixos kernel:  </TASK>
Dec 17 02:00:29 nixos dbus-daemon[1226]: [session uid=1001 pid=1226] Activating service name='org.kde.Shutdown' requested by ':1.51' (uid=1001 pid=2864 comm="qdbus org.kde.Shutdown>
Dec 17 02:00:29 nixos dbus-daemon[1226]: [session uid=1001 pid=1226] Successfully activated service 'org.kde.Shutdown'
Dec 17 02:00:29 nixos systemd[1198]: Stopped target plasma-workspace-wayland.target.
Dec 17 02:00:29 nixos systemd[1198]: Stopping Accessibility...
Dec 17 02:00:29 nixos systemd[1198]: Stopping KDE Connect...
Dec 17 02:00:29 nixos systemd[1198]: Stopping Xdg Desktop Portal For KDE...
Dec 17 02:00:29 nixos systemd[1198]: Stopping Portal service...
Dec 17 02:00:29 nixos systemd[1198]: Stopping flatpak document portal service...
Dec 17 02:00:29 nixos systemd[1198]: Stopping sandboxed app permission store...
Dec 17 02:00:29 nixos systemd[1198]: Stopped sandboxed app permission store.
Dec 17 02:00:29 nixos systemd[1]: run-user-1001-doc.mount: Deactivated successfully.
Dec 17 02:00:30 nixos systemd[1198]: Stopped Accessibility.
Dec 17 02:00:31 nixos systemd[1198]: Stopped Portal service.
Dec 17 02:00:31 nixos systemd[1198]: xdg-desktop-portal.service: Consumed 1.836s CPU time.
Dec 17 02:00:33 nixos systemd[1198]: Stopped KDE Connect.
Dec 17 02:00:33 nixos systemd[1198]: Stopped target Current graphical user session.
Dec 17 02:00:33 nixos systemd[1198]: Stopped target KDE Plasma Workspace.
Dec 17 02:00:33 nixos systemd[1198]: Stopping KActivityManager Activity manager Service...
Dec 17 02:00:33 nixos systemd[1198]: Stopping KDE PolicyKit Authentication Agent...
Dec 17 02:00:33 nixos systemd[1198]: Stopping Powerdevil...
Dec 17 02:00:33 nixos systemd[1198]: Stopping Baloo File Indexer Daemon...
Dec 17 02:00:33 nixos systemd[1198]: Stopped target Startup of XDG autostart applications.
Dec 17 02:00:33 nixos systemd[1198]: Stopped KActivityManager Activity manager Service.
Dec 17 02:00:33 nixos systemd[1198]: Stopped Powerdevil.
Dec 17 02:00:33 nixos systemd[1198]: Stopped Baloo File Indexer Daemon.
Dec 17 02:00:33 nixos systemd[1198]: kde-baloo.service: Consumed 3min 52.402s CPU time.
```

It seems in the above log that I succeeded turning it off the right way, but the shutdown hanged half way, and I had to use power button.

And I've already had that twice since switching to kernel 6.6.5.
Comment 6 chris 2023-12-30 23:51:58 UTC
Giving some news.
Regarding https://community.intel.com/t5/Wireless/AX210-system-crash-after-iwlwifi-Queue-stuck-error/m-p/1550753 I was sort of compelled to close the issue because once a would-be solution has been suggested you have to either accept it or disprove it within a week.
However even though crashes might occur less often, the exact same bug still happens with a once every week frequency:

```
Dec 30 23:03:27 nixos kernel: iwlwifi 0000:08:00.0: Queue 3 is stuck 46246 46312
Dec 30 23:03:27 nixos wireplumber[1495]: 0x18c4cf8: (0 suppressed) out of buffers on port 0 2
Dec 30 23:03:48 nixos kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
Dec 30 23:03:48 nixos kernel: rcu:         8-....: (27 GPs behind) idle=4b4c/1/0x4000000000000002 softirq=1230951/1230951 fqs=4760
Dec 30 23:03:48 nixos kernel: rcu:         (detected by 5, t=21002 jiffies, g=7966773, q=18869 ncpus=12)
```

Computer has to be power button turned off.
So not all is well.

I'm going to wait for kernel 6.7 to see if things improve.
Comment 7 chris 2024-01-03 05:31:11 UTC
And again, with computer crash:

```
Jan 03 02:37:42 nixos kernel: iwlwifi 0000:08:00.0: Queue 4 is stuck 26083 26090
Jan 03 02:38:03 nixos kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
Jan 03 02:38:03 nixos kernel: rcu:         11-....: (9 GPs behind) idle=09b4/1/0x4000000000000002 softirq=1211776/1211777 fqs=4962
Jan 03 02:38:03 nixos kernel: rcu:         (detected by 6, t=21002 jiffies, g=5909913, q=5828 ncpus=12)
Jan 03 02:38:03 nixos kernel: Sending NMI from CPU 6 to CPUs 11:

```

So really the solution from https://community.intel.com/t5/Wireless/AX210-system-crash-after-iwlwifi-Queue-stuck-error/m-p/1550753 makes makes no difference at all.

I should reopen the issue at community.intel.com asap.
Comment 8 chris 2024-01-12 06:13:49 UTC
I've waited to have kernel 6.7 which comes with new firmware, I had high hopes that it would fix things, but it didn't, I'm still experimenting the exact same issue.
You can read about that here:
https://community.intel.com/t5/Wireless/AX210-System-Crash-after-iwlwifi-Queue-Stuck-Error-Issue/m-p/1562147

I copy some info here:

```
$ hostnamectl
Static hostname: nixos
Operating System: NixOS 24.05 (Uakari)
Kernel: Linux 6.7.0
Architecture: x86-64
Hardware Vendor: ASUS
Hardware Model: ROG STRIX X670E-E GAMING WIFI
Firmware Version: 1602
Firmware Date: Tue 2023-08-15
```

```
$ journalctl -b 0 | grep "firmware version"
Jan 12 05:03:44 nixos kernel: iwlwifi 0000:08:00.0: loaded firmware version 86.fb5c9aeb.0 ty-a0-gf-a0-86.ucode op_mode iwlmvm
```

```
Jan 12 05:00:55 nixos kernel: iwlwifi 0000:08:00.0: Queue 4 is stuck 29100 29144
Jan 12 05:01:02 nixos org.freedesktop.Akonadi.Control[9701]: org.kde.pim.imapresource: "metafont" : "Connection to server lost."
Jan 12 05:01:02 nixos org.freedesktop.Akonadi.Control[9695]: org.kde.pim.imapresource: "[Gmail]/Important" : "Connection to server lost."
Jan 12 05:01:06 nixos kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
Jan 12 05:01:06 nixos kernel: rcu: 10-....: (2 ticks this GP) idle=d1ac/1/0x4000000000000002 softirq=1972394/1972394 fqs=5036
Jan 12 05:01:06 nixos kernel: rcu: (detected by 6, t=21002 jiffies, g=10564093, q=7055 ncpus=12)
Jan 12 05:01:06 nixos kernel: Sending NMI from CPU 6 to CPUs 10:
```
Comment 9 Adam 2024-01-15 16:58:52 UTC
I have also been experiencing this for quite a while now. I'm patiently awaiting kernel 6.7 from Fedora, and I seem to be on an older iwlwifi firmware, but I figured I would add my log here in case it is of any help. Please let me know if it is considered unhelpful due to my older firmware. I'd rather keep relevant information here for anyone willing to look into the issue.

```
$ hostnamectl
     Static hostname: (unset)                             
  Transient hostname: fedora
    Operating System: Fedora Linux 39.20240112.0 (Kinoite)
         CPE OS Name: cpe:/o:fedoraproject:fedora:39
              Kernel: Linux 6.6.9-200.fc39.x86_64
        Architecture: x86-64
     Hardware Vendor: ASUS
      Hardware Model: ROG STRIX X670E-E GAMING WIFI
    Firmware Version: 1602
       Firmware Date: Tue 2023-08-15
```

```
$ journalctl -b -3 | grep "firmware version"
Jan 15 10:19:48 fedora kernel: iwlwifi 0000:0a:00.0: loaded firmware version 83.e8f84e98.0 ty-a0-gf-a0-83.ucode op_mode iwlmvm
```

```
$ journalctl -b -3
Jan 15 10:31:50 fedora kernel: iwlwifi 0000:0a:00.0: Error sending STATISTICS_CMD: time out after 2000ms.
Jan 15 10:31:50 fedora kernel: iwlwifi 0000:0a:00.0: Current CMD queue read_ptr 1405 write_ptr 1406
Jan 15 10:31:58 fedora kernel: iwlwifi 0000:0a:00.0: Queue 4 is stuck 12684 12704
Jan 15 10:32:17 fedora kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 26s! [NetworkManager:1502]
Jan 15 10:32:17 fedora kernel: Modules linked in: uinput rfcomm snd_seq_dummy snd_hrtimer nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ip_set nf_tables nfnetlink qrtr bnep sunrpc binfmt_misc iwlmvm mac80211 libarc4 snd_hda_codec_hdmi snd_hda_intel snd_usb_audio snd_intel_dspcfg snd_intel_sdw_acpi intel_rapl_msr snd_hda_codec intel_rapl_common snd_usbmidi_lib snd_ump iwlwifi edac_mce_amd snd_hda_core snd_rawmidi btusb mc snd_hwdep btrtl kvm_amd btintel snd_seq btbcm vfat fat btmtk kvm snd_seq_device irqbypass cfg80211 bluetooth snd_pcm eeepc_wmi asus_nb_wmi asus_wmi ledtrig_audio snd_timer sparse_keymap snd platform_profile rapl wmi_bmof k10temp igc pcspkr i2c_piix4 joydev rfkill soundcore gpio_amdpt gpio_generic loop zram nvme nvme_core nvme_common amdgpu drm_exec amdxcp drm_buddy gpu_sched crct10dif_pclmul crc32_pclmul crc32c_intel polyval_clmulni
Jan 15 10:32:17 fedora kernel:  polyval_generic i2c_algo_bit drm_suballoc_helper drm_display_helper ghash_clmulni_intel sha512_ssse3 cec sha256_ssse3 sha1_ssse3 drm_ttm_helper ccp ttm sp5100_tco video wmi ip6_tables ip_tables fuse
Jan 15 10:32:17 fedora kernel: CPU: 2 PID: 1502 Comm: NetworkManager Not tainted 6.6.9-200.fc39.x86_64 #1
Jan 15 10:32:17 fedora kernel: Hardware name: ASUS System Product Name/ROG STRIX X670E-E GAMING WIFI, BIOS 1602 08/15/2023
Jan 15 10:32:17 fedora kernel: RIP: 0010:iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Jan 15 10:32:17 fedora kernel: Code: 1f 80 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 0f 1f 44 00 00 89 f6 48 03 b7 48 35 00 00 8b 06 <e9> c7 9d ba f5 0f 1f 80 00 00 00 00 90 90 90 90 90 90 90 90 90 90
Jan 15 10:32:17 fedora kernel: RSP: 0018:ffffc90001abf438 EFLAGS: 00000286
Jan 15 10:32:17 fedora kernel: RAX: 00000000ffffffff RBX: 00000000000004ba RCX: 0000000000000002
Jan 15 10:32:17 fedora kernel: RDX: 000000000000056a RSI: ffffc90001758024 RDI: ffff888107078028
Jan 15 10:32:17 fedora kernel: RBP: ffff888107078028 R08: 0000000000003a98 R09: 0000000000000101
Jan 15 10:32:17 fedora kernel: R10: ffffffffb8206100 R11: 0000000000034140 R12: 0000000000000011
Jan 15 10:32:17 fedora kernel: R13: 0000000000000001 R14: 0000000000000024 R15: 0000000000003a98
Jan 15 10:32:17 fedora kernel: FS:  00007f007be73540(0000) GS:ffff889018280000(0000) knlGS:0000000000000000
Jan 15 10:32:17 fedora kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jan 15 10:32:17 fedora kernel: CR2: 00003f4073362180 CR3: 000000010d00a000 CR4: 0000000000f50ee0
Jan 15 10:32:17 fedora kernel: PKRU: 55555554
Jan 15 10:32:17 fedora kernel: Call Trace:
Jan 15 10:32:17 fedora kernel:  <IRQ>
Jan 15 10:32:17 fedora kernel:  ? watchdog_timer_fn+0x1b8/0x220
Jan 15 10:32:17 fedora kernel:  ? __pfx_watchdog_timer_fn+0x10/0x10
Jan 15 10:32:17 fedora kernel:  ? __hrtimer_run_queues+0x10f/0x2b0
Jan 15 10:32:17 fedora kernel:  ? hrtimer_interrupt+0xf8/0x230
Jan 15 10:32:17 fedora kernel:  ? __sysvec_apic_timer_interrupt+0x4d/0x140
Jan 15 10:32:17 fedora kernel:  ? sysvec_apic_timer_interrupt+0x6d/0x90
Jan 15 10:32:17 fedora kernel:  </IRQ>
Jan 15 10:32:17 fedora kernel:  <TASK>
Jan 15 10:32:17 fedora kernel:  ? asm_sysvec_apic_timer_interrupt+0x1a/0x20
Jan 15 10:32:17 fedora kernel:  ? iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Jan 15 10:32:17 fedora kernel:  ? srso_alias_return_thunk+0x5/0x7f
Jan 15 10:32:17 fedora kernel:  iwl_poll_bit+0x4b/0x80 [iwlwifi]
Jan 15 10:32:17 fedora kernel:  __iwl_trans_pcie_grab_nic_access+0xb7/0x150 [iwlwifi]
Jan 15 10:32:17 fedora kernel:  iwl_trans_pcie_grab_nic_access+0x1a/0x40 [iwlwifi]
Jan 15 10:32:17 fedora kernel:  iwl_force_nmi+0xdf/0x110 [iwlwifi]
Jan 15 10:32:17 fedora kernel:  iwl_trans_sync_nmi_with_addr+0x14b/0x170 [iwlwifi]
Jan 15 10:32:17 fedora kernel:  ? srso_alias_return_thunk+0x5/0x7f
Jan 15 10:32:17 fedora kernel:  iwl_trans_txq_send_hcmd+0x401/0x450 [iwlwifi]
Jan 15 10:32:17 fedora kernel:  ? __pfx_autoremove_wake_function+0x10/0x10
Jan 15 10:32:17 fedora kernel:  iwl_trans_send_cmd+0x98/0x100 [iwlwifi]
Jan 15 10:32:17 fedora kernel:  iwl_mvm_send_cmd+0x1f/0x60 [iwlmvm]
Jan 15 10:32:17 fedora kernel:  iwl_mvm_request_statistics+0x124/0x1b0 [iwlmvm]
Jan 15 10:32:17 fedora kernel:  ? __pfx_iwl_wait_stats_complete+0x10/0x10 [iwlmvm]
Jan 15 10:32:17 fedora kernel:  iwl_mvm_mac_sta_statistics+0x18b/0x3b0 [iwlmvm]
Jan 15 10:32:17 fedora kernel:  sta_set_sinfo+0xd9/0xc00 [mac80211]
Jan 15 10:32:17 fedora kernel:  ieee80211_dump_station+0x6f/0x90 [mac80211]
Jan 15 10:32:17 fedora kernel:  nl80211_dump_station+0x13f/0x290 [cfg80211]
Jan 15 10:32:17 fedora kernel:  genl_dumpit+0x33/0x90
Jan 15 10:32:17 fedora kernel:  netlink_dump+0x126/0x320
Jan 15 10:32:17 fedora kernel:  __netlink_dump_start+0x1d6/0x290
Jan 15 10:32:17 fedora kernel:  genl_family_rcv_msg_dumpit+0x9c/0x100
Jan 15 10:32:17 fedora kernel:  ? free_unref_page+0xf6/0x180
Jan 15 10:32:17 fedora kernel:  ? __pfx_genl_start+0x10/0x10
Jan 15 10:32:17 fedora kernel:  ? __pfx_genl_dumpit+0x10/0x10
Jan 15 10:32:17 fedora kernel:  ? __pfx_genl_done+0x10/0x10
Jan 15 10:32:17 fedora kernel:  genl_rcv_msg+0x146/0x2c0
Jan 15 10:32:17 fedora kernel:  ? __pfx_nl80211_dump_station+0x10/0x10 [cfg80211]
Jan 15 10:32:17 fedora kernel:  ? __pfx_genl_rcv_msg+0x10/0x10
Jan 15 10:32:17 fedora kernel:  netlink_rcv_skb+0x58/0x110
Jan 15 10:32:17 fedora kernel:  genl_rcv+0x28/0x40
Jan 15 10:32:17 fedora kernel:  netlink_unicast+0x1a3/0x290
Jan 15 10:32:17 fedora kernel:  netlink_sendmsg+0x254/0x4d0
Jan 15 10:32:17 fedora kernel:  ____sys_sendmsg+0x396/0x3d0
Jan 15 10:32:17 fedora kernel:  ? copy_msghdr_from_user+0x7d/0xc0
Jan 15 10:32:17 fedora kernel:  ___sys_sendmsg+0x9a/0xe0
Jan 15 10:32:17 fedora kernel:  ? __pfx_pollwake+0x10/0x10
Jan 15 10:32:17 fedora kernel:  __sys_sendmsg+0x7a/0xd0
Jan 15 10:32:17 fedora kernel:  do_syscall_64+0x5d/0x90
Jan 15 10:32:17 fedora kernel:  ? srso_alias_return_thunk+0x5/0x7f
Jan 15 10:32:17 fedora kernel:  ? __x64_sys_epoll_wait+0x73/0x110
Jan 15 10:32:17 fedora kernel:  ? srso_alias_return_thunk+0x5/0x7f
Jan 15 10:32:17 fedora kernel:  ? syscall_exit_to_user_mode+0x2b/0x40
Jan 15 10:32:17 fedora kernel:  ? srso_alias_return_thunk+0x5/0x7f
Jan 15 10:32:17 fedora kernel:  ? do_syscall_64+0x6c/0x90
Jan 15 10:32:17 fedora kernel:  ? syscall_exit_to_user_mode+0x2b/0x40
Jan 15 10:32:17 fedora kernel:  ? srso_alias_return_thunk+0x5/0x7f
Jan 15 10:32:17 fedora kernel:  ? do_syscall_64+0x6c/0x90
Jan 15 10:32:17 fedora kernel:  ? do_syscall_64+0x6c/0x90
Jan 15 10:32:17 fedora kernel:  ? do_syscall_64+0x6c/0x90
Jan 15 10:32:17 fedora kernel:  ? do_syscall_64+0x6c/0x90
Jan 15 10:32:17 fedora kernel:  entry_SYSCALL_64_after_hwframe+0x6e/0xd8
Jan 15 10:32:17 fedora kernel: RIP: 0033:0x7f007cfb4a5b
Jan 15 10:32:17 fedora kernel: Code: 48 89 e5 48 83 ec 20 89 55 ec 48 89 75 f0 89 7d f8 e8 c9 2f f7 ff 8b 55 ec 48 8b 75 f0 41 89 c0 8b 7d f8 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 2d 44 89 c7 48 89 45 f8 e8 21 30 f7 ff 48 8b
Jan 15 10:32:17 fedora kernel: RSP: 002b:00007fff4a639fa0 EFLAGS: 00000293 ORIG_RAX: 000000000000002e
Jan 15 10:32:17 fedora kernel: RAX: ffffffffffffffda RBX: 000055bb4779c2a0 RCX: 00007f007cfb4a5b
Jan 15 10:32:17 fedora kernel: RDX: 0000000000000000 RSI: 00007fff4a639fe0 RDI: 000000000000000b
Jan 15 10:32:17 fedora kernel: RBP: 00007fff4a639fc0 R08: 0000000000000000 R09: 00007f007d075b80
Jan 15 10:32:17 fedora kernel: R10: 0000000000000080 R11: 0000000000000293 R12: 000055bb478153c0
Jan 15 10:32:17 fedora kernel: R13: 00007fff4a63a070 R14: 000055bb4779c2a0 R15: 00007fff4a63a2c4
Jan 15 10:32:17 fedora kernel:  </TASK>
Jan 15 10:32:21 fedora kernel: watchdog: BUG: soft lockup - CPU#21 stuck for 22s! [swapper/21:0]
Jan 15 10:32:21 fedora kernel: Modules linked in: uinput rfcomm snd_seq_dummy snd_hrtimer nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ip_set nf_tables nfnetlink qrtr bnep sunrpc binfmt_misc iwlmvm mac80211 libarc4 snd_hda_codec_hdmi snd_hda_intel snd_usb_audio snd_intel_dspcfg snd_intel_sdw_acpi intel_rapl_msr snd_hda_codec intel_rapl_common snd_usbmidi_lib snd_ump iwlwifi edac_mce_amd snd_hda_core snd_rawmidi btusb mc snd_hwdep btrtl kvm_amd btintel snd_seq btbcm vfat fat btmtk kvm snd_seq_device irqbypass cfg80211 bluetooth snd_pcm eeepc_wmi asus_nb_wmi asus_wmi ledtrig_audio snd_timer sparse_keymap snd platform_profile rapl wmi_bmof k10temp igc pcspkr i2c_piix4 joydev rfkill soundcore gpio_amdpt gpio_generic loop zram nvme nvme_core nvme_common amdgpu drm_exec amdxcp drm_buddy gpu_sched crct10dif_pclmul crc32_pclmul crc32c_intel polyval_clmulni
Jan 15 10:32:21 fedora kernel:  polyval_generic i2c_algo_bit drm_suballoc_helper drm_display_helper ghash_clmulni_intel sha512_ssse3 cec sha256_ssse3 sha1_ssse3 drm_ttm_helper ccp ttm sp5100_tco video wmi ip6_tables ip_tables fuse
Jan 15 10:32:21 fedora kernel: CPU: 21 PID: 0 Comm: swapper/21 Tainted: G             L     6.6.9-200.fc39.x86_64 #1
Jan 15 10:32:21 fedora kernel: Hardware name: ASUS System Product Name/ROG STRIX X670E-E GAMING WIFI, BIOS 1602 08/15/2023
Jan 15 10:32:21 fedora kernel: RIP: 0010:native_queued_spin_lock_slowpath+0x71/0x2b0
Jan 15 10:32:21 fedora kernel: Code: 0f ba 2b 08 0f 92 c2 8b 03 0f b6 d2 c1 e2 08 30 e4 09 d0 3d ff 00 00 00 77 53 85 c0 74 10 0f b6 03 84 c0 74 09 f3 90 0f b6 03 <84> c0 75 f7 b8 01 00 00 00 66 89 03 5b 5d 41 5c 41 5d e9 f8 11 00
Jan 15 10:32:21 fedora kernel: RSP: 0018:ffffc900006fce28 EFLAGS: 00000202
Jan 15 10:32:21 fedora kernel: RAX: 0000000000000001 RBX: ffff88810707b5e4 RCX: ffffffffc16bd540
Jan 15 10:32:21 fedora kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff88810707b5e4
Jan 15 10:32:21 fedora kernel: RBP: 0000000000d05c04 R08: 0000000000000000 R09: ffffc900006fcbc0
Jan 15 10:32:21 fedora kernel: R10: 0000000000000003 R11: ffffffffb8346508 R12: ffffffffc145e520
Jan 15 10:32:21 fedora kernel: R13: ffff8881158a0330 R14: ffff88810707b5e4 R15: ffff889018762280
Jan 15 10:32:21 fedora kernel: FS:  0000000000000000(0000) GS:ffff889018740000(0000) knlGS:0000000000000000
Jan 15 10:32:21 fedora kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jan 15 10:32:21 fedora kernel: CR2: 00007f7457956000 CR3: 0000000494222000 CR4: 0000000000f50ee0
Jan 15 10:32:21 fedora kernel: PKRU: 55555554
Jan 15 10:32:21 fedora kernel: Call Trace:
Jan 15 10:32:21 fedora kernel:  <IRQ>
Jan 15 10:32:21 fedora kernel:  ? watchdog_timer_fn+0x1b8/0x220
Jan 15 10:32:21 fedora kernel:  ? __pfx_watchdog_timer_fn+0x10/0x10
Jan 15 10:32:21 fedora kernel:  ? __hrtimer_run_queues+0x10f/0x2b0
Jan 15 10:32:21 fedora kernel:  ? hrtimer_interrupt+0xf8/0x230
Jan 15 10:32:21 fedora kernel:  ? __sysvec_apic_timer_interrupt+0x4d/0x140
Jan 15 10:32:21 fedora kernel:  ? sysvec_apic_timer_interrupt+0x39/0x90
Jan 15 10:32:21 fedora kernel:  ? asm_sysvec_apic_timer_interrupt+0x1a/0x20
Jan 15 10:32:21 fedora kernel:  ? __pfx_iwl_txq_stuck_timer+0x10/0x10 [iwlwifi]
Jan 15 10:32:21 fedora kernel:  ? native_queued_spin_lock_slowpath+0x71/0x2b0
Jan 15 10:32:21 fedora kernel:  ? __pfx_iwl_txq_stuck_timer+0x10/0x10 [iwlwifi]
Jan 15 10:32:21 fedora kernel:  _raw_spin_lock+0x29/0x30
Jan 15 10:32:21 fedora kernel:  __iwl_trans_pcie_grab_nic_access+0x25/0x150 [iwlwifi]
Jan 15 10:32:21 fedora kernel:  ? __pfx_iwl_txq_stuck_timer+0x10/0x10 [iwlwifi]
Jan 15 10:32:21 fedora kernel:  iwl_trans_pcie_grab_nic_access+0x1a/0x40 [iwlwifi]
Jan 15 10:32:21 fedora kernel:  iwl_force_nmi+0xdf/0x110 [iwlwifi]
Jan 15 10:32:21 fedora kernel:  call_timer_fn+0x24/0x130
Jan 15 10:32:21 fedora kernel:  ? __pfx_iwl_txq_stuck_timer+0x10/0x10 [iwlwifi]
Jan 15 10:32:21 fedora kernel:  __run_timers+0x222/0x2c0
Jan 15 10:32:21 fedora kernel:  run_timer_softirq+0x1d/0x40
Jan 15 10:32:21 fedora kernel:  __do_softirq+0xd1/0x2c8
Jan 15 10:32:21 fedora kernel:  __irq_exit_rcu+0xa6/0xc0
Jan 15 10:32:21 fedora kernel:  sysvec_apic_timer_interrupt+0x72/0x90
Jan 15 10:32:21 fedora kernel:  </IRQ>
Jan 15 10:32:21 fedora kernel:  <TASK>
Jan 15 10:32:21 fedora kernel:  asm_sysvec_apic_timer_interrupt+0x1a/0x20
Jan 15 10:32:21 fedora kernel: RIP: 0010:cpuidle_enter_state+0xcc/0x440
Jan 15 10:32:21 fedora kernel: Code: ea be 1a ff e8 c5 f3 ff ff 8b 53 04 49 89 c5 0f 1f 44 00 00 31 ff e8 73 c2 19 ff 45 84 ff 0f 85 56 02 00 00 fb 0f 1f 44 00 00 <45> 85 f6 0f 88 85 01 00 00 49 63 d6 48 8d 04 52 48 8d 04 82 49 8d
Jan 15 10:32:21 fedora kernel: RSP: 0018:ffffc9000025fe90 EFLAGS: 00000246
Jan 15 10:32:21 fedora kernel: RAX: ffff889018774140 RBX: ffff88810e71b000 RCX: 000000000000001f
Jan 15 10:32:21 fedora kernel: RDX: 0000000000000015 RSI: 000000001e79f308 RDI: 0000000000000000
Jan 15 10:32:21 fedora kernel: RBP: 0000000000000002 R08: 0000000000000002 R09: 0000000000000288
Jan 15 10:32:21 fedora kernel: R10: 0000000000000006 R11: ffff889018772aa4 R12: ffffffffb8447200
Jan 15 10:32:21 fedora kernel: R13: 000000aba6eddf17 R14: 0000000000000002 R15: 0000000000000000
Jan 15 10:32:21 fedora kernel:  cpuidle_enter+0x2d/0x40
Jan 15 10:32:21 fedora kernel:  do_idle+0x20d/0x270
Jan 15 10:32:21 fedora kernel:  cpu_startup_entry+0x2a/0x30
Jan 15 10:32:21 fedora kernel:  start_secondary+0x11e/0x140
Jan 15 10:32:21 fedora kernel:  secondary_startup_64_no_verify+0x18f/0x19b
Jan 15 10:32:21 fedora kernel:  </TASK>
Jan 15 10:32:45 fedora kernel: watchdog: BUG: soft lockup - CPU#2 stuck for 52s! [NetworkManager:1502]
Jan 15 10:32:45 fedora kernel: Modules linked in: uinput rfcomm snd_seq_dummy snd_hrtimer nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ip_set nf_tables nfnetlink qrtr bnep sunrpc binfmt_misc iwlmvm mac80211 libarc4 snd_hda_codec_hdmi snd_hda_intel snd_usb_audio snd_intel_dspcfg snd_intel_sdw_acpi intel_rapl_msr snd_hda_codec intel_rapl_common snd_usbmidi_lib snd_ump iwlwifi edac_mce_amd snd_hda_core snd_rawmidi btusb mc snd_hwdep btrtl kvm_amd btintel snd_seq btbcm vfat fat btmtk kvm snd_seq_device irqbypass cfg80211 bluetooth snd_pcm eeepc_wmi asus_nb_wmi asus_wmi ledtrig_audio snd_timer sparse_keymap snd platform_profile rapl wmi_bmof k10temp igc pcspkr i2c_piix4 joydev rfkill soundcore gpio_amdpt gpio_generic loop zram nvme nvme_core nvme_common amdgpu drm_exec amdxcp drm_buddy gpu_sched crct10dif_pclmul crc32_pclmul crc32c_intel polyval_clmulni
Jan 15 10:32:45 fedora kernel:  polyval_generic i2c_algo_bit drm_suballoc_helper drm_display_helper ghash_clmulni_intel sha512_ssse3 cec sha256_ssse3 sha1_ssse3 drm_ttm_helper ccp ttm sp5100_tco video wmi ip6_tables ip_tables fuse
Jan 15 10:32:45 fedora kernel: CPU: 2 PID: 1502 Comm: NetworkManager Tainted: G             L     6.6.9-200.fc39.x86_64 #1
Jan 15 10:32:45 fedora kernel: Hardware name: ASUS System Product Name/ROG STRIX X670E-E GAMING WIFI, BIOS 1602 08/15/2023
Jan 15 10:32:45 fedora kernel: RIP: 0010:iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Jan 15 10:32:45 fedora kernel: Code: 1f 80 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 0f 1f 44 00 00 89 f6 48 03 b7 48 35 00 00 8b 06 <e9> c7 9d ba f5 0f 1f 80 00 00 00 00 90 90 90 90 90 90 90 90 90 90
Jan 15 10:32:45 fedora kernel: RSP: 0018:ffffc90001abf438 EFLAGS: 00000286
Jan 15 10:32:45 fedora kernel: RAX: 00000000ffffffff RBX: 00000000000009ba RCX: 0000000000000002
Jan 15 10:32:45 fedora kernel: RDX: 000000000000056a RSI: ffffc90001758024 RDI: ffff888107078028
Jan 15 10:32:45 fedora kernel: RBP: ffff888107078028 R08: 0000000000003a98 R09: 0000000000000101
Jan 15 10:32:45 fedora kernel: R10: ffffffffb8206100 R11: 0000000000034140 R12: 0000000000000011
Jan 15 10:32:45 fedora kernel: R13: 0000000000000001 R14: 0000000000000024 R15: 0000000000003a98
Jan 15 10:32:45 fedora kernel: FS:  00007f007be73540(0000) GS:ffff889018280000(0000) knlGS:0000000000000000
Jan 15 10:32:45 fedora kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jan 15 10:32:45 fedora kernel: CR2: 00003f4073362180 CR3: 000000010d00a000 CR4: 0000000000f50ee0
Jan 15 10:32:45 fedora kernel: PKRU: 55555554
Jan 15 10:32:45 fedora kernel: Call Trace:
Jan 15 10:32:45 fedora kernel:  <IRQ>
Jan 15 10:32:45 fedora kernel:  ? watchdog_timer_fn+0x1b8/0x220
Jan 15 10:32:45 fedora kernel:  ? __pfx_watchdog_timer_fn+0x10/0x10
Jan 15 10:32:45 fedora kernel:  ? __hrtimer_run_queues+0x10f/0x2b0
Jan 15 10:32:45 fedora kernel:  ? hrtimer_interrupt+0xf8/0x230
Jan 15 10:32:45 fedora kernel:  ? __sysvec_apic_timer_interrupt+0x4d/0x140
Jan 15 10:32:45 fedora kernel:  ? sysvec_apic_timer_interrupt+0x6d/0x90
Jan 15 10:32:45 fedora kernel:  </IRQ>
Jan 15 10:32:45 fedora kernel:  <TASK>
Jan 15 10:32:45 fedora kernel:  ? asm_sysvec_apic_timer_interrupt+0x1a/0x20
Jan 15 10:32:45 fedora kernel:  ? iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Jan 15 10:32:45 fedora kernel:  ? srso_alias_return_thunk+0x5/0x7f
Jan 15 10:32:45 fedora kernel:  iwl_poll_bit+0x4b/0x80 [iwlwifi]
Jan 15 10:32:45 fedora kernel:  __iwl_trans_pcie_grab_nic_access+0xb7/0x150 [iwlwifi]
Jan 15 10:32:45 fedora kernel:  iwl_trans_pcie_grab_nic_access+0x1a/0x40 [iwlwifi]
Jan 15 10:32:45 fedora kernel:  iwl_force_nmi+0xdf/0x110 [iwlwifi]
Jan 15 10:32:45 fedora kernel:  iwl_trans_sync_nmi_with_addr+0x14b/0x170 [iwlwifi]
Jan 15 10:32:45 fedora kernel:  ? srso_alias_return_thunk+0x5/0x7f
Jan 15 10:32:45 fedora kernel:  iwl_trans_txq_send_hcmd+0x401/0x450 [iwlwifi]
Jan 15 10:32:45 fedora kernel:  ? __pfx_autoremove_wake_function+0x10/0x10
Jan 15 10:32:45 fedora kernel:  iwl_trans_send_cmd+0x98/0x100 [iwlwifi]
Jan 15 10:32:45 fedora kernel:  iwl_mvm_send_cmd+0x1f/0x60 [iwlmvm]
Jan 15 10:32:45 fedora kernel:  iwl_mvm_request_statistics+0x124/0x1b0 [iwlmvm]
Jan 15 10:32:45 fedora kernel:  ? __pfx_iwl_wait_stats_complete+0x10/0x10 [iwlmvm]
Jan 15 10:32:45 fedora kernel:  iwl_mvm_mac_sta_statistics+0x18b/0x3b0 [iwlmvm]
Jan 15 10:32:45 fedora kernel:  sta_set_sinfo+0xd9/0xc00 [mac80211]
Jan 15 10:32:45 fedora kernel:  ieee80211_dump_station+0x6f/0x90 [mac80211]
Jan 15 10:32:45 fedora kernel:  nl80211_dump_station+0x13f/0x290 [cfg80211]
Jan 15 10:32:45 fedora kernel:  genl_dumpit+0x33/0x90
Jan 15 10:32:45 fedora kernel:  netlink_dump+0x126/0x320
Jan 15 10:32:45 fedora kernel:  __netlink_dump_start+0x1d6/0x290
Jan 15 10:32:45 fedora kernel:  genl_family_rcv_msg_dumpit+0x9c/0x100
Jan 15 10:32:45 fedora kernel:  ? free_unref_page+0xf6/0x180
Jan 15 10:32:45 fedora kernel:  ? __pfx_genl_start+0x10/0x10
Jan 15 10:32:45 fedora kernel:  ? __pfx_genl_dumpit+0x10/0x10
Jan 15 10:32:45 fedora kernel:  ? __pfx_genl_done+0x10/0x10
Jan 15 10:32:45 fedora kernel:  genl_rcv_msg+0x146/0x2c0
Jan 15 10:32:45 fedora kernel:  ? __pfx_nl80211_dump_station+0x10/0x10 [cfg80211]
Jan 15 10:32:45 fedora kernel:  ? __pfx_genl_rcv_msg+0x10/0x10
Jan 15 10:32:45 fedora kernel:  netlink_rcv_skb+0x58/0x110
Jan 15 10:32:45 fedora kernel:  genl_rcv+0x28/0x40
Jan 15 10:32:45 fedora kernel:  netlink_unicast+0x1a3/0x290
Jan 15 10:32:45 fedora kernel:  netlink_sendmsg+0x254/0x4d0
Jan 15 10:32:45 fedora kernel:  ____sys_sendmsg+0x396/0x3d0
Jan 15 10:32:45 fedora kernel:  ? copy_msghdr_from_user+0x7d/0xc0
Jan 15 10:32:45 fedora kernel:  ___sys_sendmsg+0x9a/0xe0
Jan 15 10:32:45 fedora kernel:  ? __pfx_pollwake+0x10/0x10
Jan 15 10:32:45 fedora kernel:  __sys_sendmsg+0x7a/0xd0
Jan 15 10:32:45 fedora kernel:  do_syscall_64+0x5d/0x90
Jan 15 10:32:45 fedora kernel:  ? srso_alias_return_thunk+0x5/0x7f
Jan 15 10:32:45 fedora kernel:  ? __x64_sys_epoll_wait+0x73/0x110
Jan 15 10:32:45 fedora kernel:  ? srso_alias_return_thunk+0x5/0x7f
Jan 15 10:32:45 fedora kernel:  ? syscall_exit_to_user_mode+0x2b/0x40
Jan 15 10:32:45 fedora kernel:  ? srso_alias_return_thunk+0x5/0x7f
Jan 15 10:32:45 fedora kernel:  ? do_syscall_64+0x6c/0x90
Jan 15 10:32:45 fedora kernel:  ? syscall_exit_to_user_mode+0x2b/0x40
Jan 15 10:32:45 fedora kernel:  ? srso_alias_return_thunk+0x5/0x7f
Jan 15 10:32:45 fedora kernel:  ? do_syscall_64+0x6c/0x90
Jan 15 10:32:45 fedora kernel:  ? do_syscall_64+0x6c/0x90
Jan 15 10:32:45 fedora kernel:  ? do_syscall_64+0x6c/0x90
Jan 15 10:32:45 fedora kernel:  ? do_syscall_64+0x6c/0x90
Jan 15 10:32:45 fedora kernel:  entry_SYSCALL_64_after_hwframe+0x6e/0xd8
Jan 15 10:32:45 fedora kernel: RIP: 0033:0x7f007cfb4a5b
Jan 15 10:32:45 fedora kernel: Code: 48 89 e5 48 83 ec 20 89 55 ec 48 89 75 f0 89 7d f8 e8 c9 2f f7 ff 8b 55 ec 48 8b 75 f0 41 89 c0 8b 7d f8 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 2d 44 89 c7 48 89 45 f8 e8 21 30 f7 ff 48 8b
Jan 15 10:32:45 fedora kernel: RSP: 002b:00007fff4a639fa0 EFLAGS: 00000293 ORIG_RAX: 000000000000002e
Jan 15 10:32:45 fedora kernel: RAX: ffffffffffffffda RBX: 000055bb4779c2a0 RCX: 00007f007cfb4a5b
Jan 15 10:32:45 fedora kernel: RDX: 0000000000000000 RSI: 00007fff4a639fe0 RDI: 000000000000000b
Jan 15 10:32:45 fedora kernel: RBP: 00007fff4a639fc0 R08: 0000000000000000 R09: 00007f007d075b80
Jan 15 10:32:45 fedora kernel: R10: 0000000000000080 R11: 0000000000000293 R12: 000055bb478153c0
Jan 15 10:32:45 fedora kernel: R13: 00007fff4a63a070 R14: 000055bb4779c2a0 R15: 00007fff4a63a2c4
Jan 15 10:32:45 fedora kernel:  </TASK>
Jan 15 10:32:49 fedora kernel: watchdog: BUG: soft lockup - CPU#21 stuck for 49s! [swapper/21:0]
Jan 15 10:32:49 fedora kernel: Modules linked in: uinput rfcomm snd_seq_dummy snd_hrtimer nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ip_set nf_tables nfnetlink qrtr bnep sunrpc binfmt_misc iwlmvm mac80211 libarc4 snd_hda_codec_hdmi snd_hda_intel snd_usb_audio snd_intel_dspcfg snd_intel_sdw_acpi intel_rapl_msr snd_hda_codec intel_rapl_common snd_usbmidi_lib snd_ump iwlwifi edac_mce_amd snd_hda_core snd_rawmidi btusb mc snd_hwdep btrtl kvm_amd btintel snd_seq btbcm vfat fat btmtk kvm snd_seq_device irqbypass cfg80211 bluetooth snd_pcm eeepc_wmi asus_nb_wmi asus_wmi ledtrig_audio snd_timer sparse_keymap snd platform_profile rapl wmi_bmof k10temp igc pcspkr i2c_piix4 joydev rfkill soundcore gpio_amdpt gpio_generic loop zram nvme nvme_core nvme_common amdgpu drm_exec amdxcp drm_buddy gpu_sched crct10dif_pclmul crc32_pclmul crc32c_intel polyval_clmulni
Jan 15 10:32:49 fedora kernel:  polyval_generic i2c_algo_bit drm_suballoc_helper drm_display_helper ghash_clmulni_intel sha512_ssse3 cec sha256_ssse3 sha1_ssse3 drm_ttm_helper ccp ttm sp5100_tco video wmi ip6_tables ip_tables fuse
Jan 15 10:32:49 fedora kernel: CPU: 21 PID: 0 Comm: swapper/21 Tainted: G             L     6.6.9-200.fc39.x86_64 #1
Jan 15 10:32:49 fedora kernel: Hardware name: ASUS System Product Name/ROG STRIX X670E-E GAMING WIFI, BIOS 1602 08/15/2023
Jan 15 10:32:49 fedora kernel: RIP: 0010:native_queued_spin_lock_slowpath+0x71/0x2b0
Jan 15 10:32:49 fedora kernel: Code: 0f ba 2b 08 0f 92 c2 8b 03 0f b6 d2 c1 e2 08 30 e4 09 d0 3d ff 00 00 00 77 53 85 c0 74 10 0f b6 03 84 c0 74 09 f3 90 0f b6 03 <84> c0 75 f7 b8 01 00 00 00 66 89 03 5b 5d 41 5c 41 5d e9 f8 11 00
Jan 15 10:32:49 fedora kernel: RSP: 0018:ffffc900006fce28 EFLAGS: 00000202
Jan 15 10:32:49 fedora kernel: RAX: 0000000000000001 RBX: ffff88810707b5e4 RCX: ffffffffc16bd540
Jan 15 10:32:49 fedora kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff88810707b5e4
Jan 15 10:32:49 fedora kernel: RBP: 0000000000d05c04 R08: 0000000000000000 R09: ffffc900006fcbc0
Jan 15 10:32:49 fedora kernel: R10: 0000000000000003 R11: ffffffffb8346508 R12: ffffffffc145e520
Jan 15 10:32:49 fedora kernel: R13: ffff8881158a0330 R14: ffff88810707b5e4 R15: ffff889018762280
Jan 15 10:32:49 fedora kernel: FS:  0000000000000000(0000) GS:ffff889018740000(0000) knlGS:0000000000000000
Jan 15 10:32:49 fedora kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jan 15 10:32:49 fedora kernel: CR2: 00007f7457956000 CR3: 0000000494222000 CR4: 0000000000f50ee0
Jan 15 10:32:49 fedora kernel: PKRU: 55555554
Jan 15 10:32:49 fedora kernel: Call Trace:
Jan 15 10:32:49 fedora kernel:  <IRQ>
Jan 15 10:32:49 fedora kernel:  ? watchdog_timer_fn+0x1b8/0x220
Jan 15 10:32:49 fedora kernel:  ? __pfx_watchdog_timer_fn+0x10/0x10
Jan 15 10:32:49 fedora kernel:  ? __hrtimer_run_queues+0x10f/0x2b0
Jan 15 10:32:49 fedora kernel:  ? hrtimer_interrupt+0xf8/0x230
Jan 15 10:32:49 fedora kernel:  ? __sysvec_apic_timer_interrupt+0x4d/0x140
Jan 15 10:32:49 fedora kernel:  ? sysvec_apic_timer_interrupt+0x39/0x90
Jan 15 10:32:49 fedora kernel:  ? asm_sysvec_apic_timer_interrupt+0x1a/0x20
Jan 15 10:32:49 fedora kernel:  ? __pfx_iwl_txq_stuck_timer+0x10/0x10 [iwlwifi]
Jan 15 10:32:49 fedora kernel:  ? native_queued_spin_lock_slowpath+0x71/0x2b0
Jan 15 10:32:49 fedora kernel:  ? __pfx_iwl_txq_stuck_timer+0x10/0x10 [iwlwifi]
Jan 15 10:32:49 fedora kernel:  _raw_spin_lock+0x29/0x30
Jan 15 10:32:49 fedora kernel:  __iwl_trans_pcie_grab_nic_access+0x25/0x150 [iwlwifi]
Jan 15 10:32:49 fedora kernel:  ? __pfx_iwl_txq_stuck_timer+0x10/0x10 [iwlwifi]
Jan 15 10:32:49 fedora kernel:  iwl_trans_pcie_grab_nic_access+0x1a/0x40 [iwlwifi]
Jan 15 10:32:49 fedora kernel:  iwl_force_nmi+0xdf/0x110 [iwlwifi]
Jan 15 10:32:49 fedora kernel:  call_timer_fn+0x24/0x130
Jan 15 10:32:49 fedora kernel:  ? __pfx_iwl_txq_stuck_timer+0x10/0x10 [iwlwifi]
Jan 15 10:32:49 fedora kernel:  __run_timers+0x222/0x2c0
Jan 15 10:32:49 fedora kernel:  run_timer_softirq+0x1d/0x40
Jan 15 10:32:49 fedora kernel:  __do_softirq+0xd1/0x2c8
Jan 15 10:32:49 fedora kernel:  __irq_exit_rcu+0xa6/0xc0
Jan 15 10:32:49 fedora kernel:  sysvec_apic_timer_interrupt+0x72/0x90
Jan 15 10:32:49 fedora kernel:  </IRQ>
Jan 15 10:32:49 fedora kernel:  <TASK>
Jan 15 10:32:49 fedora kernel:  asm_sysvec_apic_timer_interrupt+0x1a/0x20
Jan 15 10:32:49 fedora kernel: RIP: 0010:cpuidle_enter_state+0xcc/0x440
Jan 15 10:32:49 fedora kernel: Code: ea be 1a ff e8 c5 f3 ff ff 8b 53 04 49 89 c5 0f 1f 44 00 00 31 ff e8 73 c2 19 ff 45 84 ff 0f 85 56 02 00 00 fb 0f 1f 44 00 00 <45> 85 f6 0f 88 85 01 00 00 49 63 d6 48 8d 04 52 48 8d 04 82 49 8d
Jan 15 10:32:49 fedora kernel: RSP: 0018:ffffc9000025fe90 EFLAGS: 00000246
Jan 15 10:32:49 fedora kernel: RAX: ffff889018774140 RBX: ffff88810e71b000 RCX: 000000000000001f
Jan 15 10:32:49 fedora kernel: RDX: 0000000000000015 RSI: 000000001e79f308 RDI: 0000000000000000
Jan 15 10:32:49 fedora kernel: RBP: 0000000000000002 R08: 0000000000000002 R09: 0000000000000288
Jan 15 10:32:49 fedora kernel: R10: 0000000000000006 R11: ffff889018772aa4 R12: ffffffffb8447200
Jan 15 10:32:49 fedora kernel: R13: 000000aba6eddf17 R14: 0000000000000002 R15: 0000000000000000
Jan 15 10:32:49 fedora kernel:  cpuidle_enter+0x2d/0x40
Jan 15 10:32:49 fedora kernel:  do_idle+0x20d/0x270
Jan 15 10:32:49 fedora kernel:  cpu_startup_entry+0x2a/0x30
Jan 15 10:32:49 fedora kernel:  start_secondary+0x11e/0x140
Jan 15 10:32:49 fedora kernel:  secondary_startup_64_no_verify+0x18f/0x19b
Jan 15 10:32:49 fedora kernel:  </TASK>
Jan 15 10:32:50 fedora kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
Jan 15 10:32:50 fedora kernel: rcu:         2-....: (275 ticks this GP) idle=19dc/1/0x4000000000000000 softirq=76024/76024 fqs=13556
Jan 15 10:32:50 fedora kernel: rcu:         (detected by 7, t=60002 jiffies, g=336801, q=28891 ncpus=32)
Jan 15 10:32:50 fedora kernel: Sending NMI from CPU 7 to CPUs 2:
Jan 15 10:32:50 fedora kernel: NMI backtrace for cpu 2
Jan 15 10:32:50 fedora kernel: CPU: 2 PID: 1502 Comm: NetworkManager Tainted: G             L     6.6.9-200.fc39.x86_64 #1
Jan 15 10:32:50 fedora kernel: Hardware name: ASUS System Product Name/ROG STRIX X670E-E GAMING WIFI, BIOS 1602 08/15/2023
Jan 15 10:32:50 fedora kernel: RIP: 0010:iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Jan 15 10:32:50 fedora kernel: Code: 1f 80 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 0f 1f 44 00 00 89 f6 48 03 b7 48 35 00 00 8b 06 <e9> c7 9d ba f5 0f 1f 80 00 00 00 00 90 90 90 90 90 90 90 90 90 90
Jan 15 10:32:50 fedora kernel: RSP: 0018:ffffc90001abf438 EFLAGS: 00000286
Jan 15 10:32:50 fedora kernel: RAX: 00000000ffffffff RBX: 0000000000000a96 RCX: 0000000000000002
Jan 15 10:32:50 fedora kernel: RDX: 000000000000056a RSI: ffffc90001758024 RDI: ffff888107078028
Jan 15 10:32:50 fedora kernel: RBP: ffff888107078028 R08: 0000000000003a98 R09: 0000000000000101
Jan 15 10:32:50 fedora kernel: R10: ffffffffb8206100 R11: 0000000000034140 R12: 0000000000000011
Jan 15 10:32:50 fedora kernel: R13: 0000000000000001 R14: 0000000000000024 R15: 0000000000003a98
Jan 15 10:32:50 fedora kernel: FS:  00007f007be73540(0000) GS:ffff889018280000(0000) knlGS:0000000000000000
Jan 15 10:32:50 fedora kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jan 15 10:32:50 fedora kernel: CR2: 00003f4073362180 CR3: 000000010d00a000 CR4: 0000000000f50ee0
Jan 15 10:32:50 fedora kernel: PKRU: 55555554
Jan 15 10:32:50 fedora kernel: Call Trace:
Jan 15 10:32:50 fedora kernel:  <NMI>
Jan 15 10:32:50 fedora kernel:  ? nmi_cpu_backtrace+0x99/0x110
Jan 15 10:32:50 fedora kernel:  ? nmi_cpu_backtrace_handler+0x11/0x20
Jan 15 10:32:50 fedora kernel:  ? nmi_handle+0x5e/0x150
Jan 15 10:32:50 fedora kernel:  ? default_do_nmi+0x40/0x100
Jan 15 10:32:50 fedora kernel:  ? exc_nmi+0x139/0x1c0
Jan 15 10:32:50 fedora kernel:  ? end_repeat_nmi+0x16/0x67
Jan 15 10:32:50 fedora kernel:  ? iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Jan 15 10:32:50 fedora kernel:  ? iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Jan 15 10:32:50 fedora kernel:  ? iwl_trans_pcie_read32+0x14/0x20 [iwlwifi]
Jan 15 10:32:50 fedora kernel:  </NMI>
Jan 15 10:32:50 fedora kernel:  <TASK>
Jan 15 10:32:50 fedora kernel:  iwl_poll_bit+0x4b/0x80 [iwlwifi]
Jan 15 10:32:50 fedora kernel:  __iwl_trans_pcie_grab_nic_access+0xb7/0x150 [iwlwifi]
Jan 15 10:32:50 fedora kernel:  iwl_trans_pcie_grab_nic_access+0x1a/0x40 [iwlwifi]
Jan 15 10:32:50 fedora kernel:  iwl_force_nmi+0xdf/0x110 [iwlwifi]
Jan 15 10:32:50 fedora kernel:  iwl_trans_sync_nmi_with_addr+0x14b/0x170 [iwlwifi]
Jan 15 10:32:50 fedora kernel:  ? srso_alias_return_thunk+0x5/0x7f
Jan 15 10:32:50 fedora kernel:  iwl_trans_txq_send_hcmd+0x401/0x450 [iwlwifi]
Jan 15 10:32:50 fedora kernel:  ? __pfx_autoremove_wake_function+0x10/0x10
Jan 15 10:32:50 fedora kernel:  iwl_trans_send_cmd+0x98/0x100 [iwlwifi]
Jan 15 10:32:50 fedora kernel:  iwl_mvm_send_cmd+0x1f/0x60 [iwlmvm]
Jan 15 10:32:50 fedora kernel:  iwl_mvm_request_statistics+0x124/0x1b0 [iwlmvm]
Jan 15 10:32:50 fedora kernel:  ? __pfx_iwl_wait_stats_complete+0x10/0x10 [iwlmvm]
Jan 15 10:32:50 fedora kernel:  iwl_mvm_mac_sta_statistics+0x18b/0x3b0 [iwlmvm]
Jan 15 10:32:50 fedora kernel:  sta_set_sinfo+0xd9/0xc00 [mac80211]
Jan 15 10:32:50 fedora kernel:  ieee80211_dump_station+0x6f/0x90 [mac80211]
Jan 15 10:32:50 fedora kernel:  nl80211_dump_station+0x13f/0x290 [cfg80211]
Jan 15 10:32:50 fedora kernel:  genl_dumpit+0x33/0x90
Jan 15 10:32:50 fedora kernel:  netlink_dump+0x126/0x320
Jan 15 10:32:50 fedora kernel:  __netlink_dump_start+0x1d6/0x290
Jan 15 10:32:50 fedora kernel:  genl_family_rcv_msg_dumpit+0x9c/0x100
Jan 15 10:32:50 fedora kernel:  ? free_unref_page+0xf6/0x180
Jan 15 10:32:50 fedora kernel:  ? __pfx_genl_start+0x10/0x10
Jan 15 10:32:50 fedora kernel:  ? __pfx_genl_dumpit+0x10/0x10
Jan 15 10:32:50 fedora kernel:  ? __pfx_genl_done+0x10/0x10
Jan 15 10:32:50 fedora kernel:  genl_rcv_msg+0x146/0x2c0
Jan 15 10:32:50 fedora kernel:  ? __pfx_nl80211_dump_station+0x10/0x10 [cfg80211]
Jan 15 10:32:50 fedora kernel:  ? __pfx_genl_rcv_msg+0x10/0x10
Jan 15 10:32:50 fedora kernel:  netlink_rcv_skb+0x58/0x110
Jan 15 10:32:50 fedora kernel:  genl_rcv+0x28/0x40
Jan 15 10:32:50 fedora kernel:  netlink_unicast+0x1a3/0x290
Jan 15 10:32:50 fedora kernel:  netlink_sendmsg+0x254/0x4d0
Jan 15 10:32:50 fedora kernel:  ____sys_sendmsg+0x396/0x3d0
Jan 15 10:32:50 fedora kernel:  ? copy_msghdr_from_user+0x7d/0xc0
Jan 15 10:32:50 fedora kernel:  ___sys_sendmsg+0x9a/0xe0
Jan 15 10:32:50 fedora kernel:  ? __pfx_pollwake+0x10/0x10
Jan 15 10:32:50 fedora kernel:  __sys_sendmsg+0x7a/0xd0
Jan 15 10:32:50 fedora kernel:  do_syscall_64+0x5d/0x90
Jan 15 10:32:50 fedora kernel:  ? srso_alias_return_thunk+0x5/0x7f
Jan 15 10:32:50 fedora kernel:  ? __x64_sys_epoll_wait+0x73/0x110
Jan 15 10:32:50 fedora kernel:  ? srso_alias_return_thunk+0x5/0x7f
Jan 15 10:32:50 fedora kernel:  ? syscall_exit_to_user_mode+0x2b/0x40
Jan 15 10:32:50 fedora kernel:  ? srso_alias_return_thunk+0x5/0x7f
Jan 15 10:32:50 fedora kernel:  ? do_syscall_64+0x6c/0x90
Jan 15 10:32:50 fedora kernel:  ? syscall_exit_to_user_mode+0x2b/0x40
Jan 15 10:32:50 fedora kernel:  ? srso_alias_return_thunk+0x5/0x7f
Jan 15 10:32:50 fedora kernel:  ? do_syscall_64+0x6c/0x90
Jan 15 10:32:50 fedora kernel:  ? do_syscall_64+0x6c/0x90
Jan 15 10:32:50 fedora kernel:  ? do_syscall_64+0x6c/0x90
Jan 15 10:32:50 fedora kernel:  ? do_syscall_64+0x6c/0x90
Jan 15 10:32:50 fedora kernel:  entry_SYSCALL_64_after_hwframe+0x6e/0xd8
Jan 15 10:32:50 fedora kernel: RIP: 0033:0x7f007cfb4a5b
Jan 15 10:32:50 fedora kernel: Code: 48 89 e5 48 83 ec 20 89 55 ec 48 89 75 f0 89 7d f8 e8 c9 2f f7 ff 8b 55 ec 48 8b 75 f0 41 89 c0 8b 7d f8 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 2d 44 89 c7 48 89 45 f8 e8 21 30 f7 ff 48 8b
Jan 15 10:32:50 fedora kernel: RSP: 002b:00007fff4a639fa0 EFLAGS: 00000293 ORIG_RAX: 000000000000002e
Jan 15 10:32:50 fedora kernel: RAX: ffffffffffffffda RBX: 000055bb4779c2a0 RCX: 00007f007cfb4a5b
Jan 15 10:32:50 fedora kernel: RDX: 0000000000000000 RSI: 00007fff4a639fe0 RDI: 000000000000000b
Jan 15 10:32:50 fedora kernel: RBP: 00007fff4a639fc0 R08: 0000000000000000 R09: 00007f007d075b80
Jan 15 10:32:50 fedora kernel: R10: 0000000000000080 R11: 0000000000000293 R12: 000055bb478153c0
Jan 15 10:32:50 fedora kernel: R13: 00007fff4a63a070 R14: 000055bb4779c2a0 R15: 00007fff4a63a2c4
Jan 15 10:32:50 fedora kernel:  </TASK>
```
Comment 10 chris 2024-01-16 21:59:15 UTC
Hi Adam,

Thank you for sharing your experience and logs. This additional information is certainly helpful as it appears we are dealing with a similar issue. Despite the difference in firmware versions, the errors you've encountered seem to align closely with what I've been experiencing.

For context, I was facing this exact problem while using firmware version `83.e8f84e98.0 ty-a0-gf-a0-83.ucode` as well, and updating to the latest firmware `86.fb5c9aeb.0 ty-a0-gf-a0-86.ucode` has not led to any noticeable improvements. Our issues may indeed be related, regardless of the firmware version.

Here is what I believe is a signature of the crash I've been experiencing, but extracted from your `journalctl` output:

```
$ egrep -i 'queue.*is stuck|rcu_preempt' fedora_journalctl_20240116
Jan 15 10:31:58 fedora kernel: iwlwifi 0000:0a:00.0: Queue 4 is stuck 12684 12704
Jan 15 10:32:50 fedora kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
```

And then the system crashes -- at least, it always does in my case.

To provide an update, I experienced another crash just yesterday. This reaffirms that the issue is still active with kernel 6.7 and the latest firmware.

Best,
Chris
Comment 11 Simon Baatz 2024-01-18 07:54:20 UTC
I am using 6.6 kernels and there is an iwlwifi fix in 6.6.11 that fixed the problems I had with the previous 6.6 kernels. (If you use Fedora: I used koji to install this kernel: https://docs.fedoraproject.org/en-US/quick-docs/kernel-installing-from-koji/)
Comment 12 chris 2024-01-18 23:52:01 UTC
Hi Simon,

Could you point to some kernel changelog, commit message, or discussion thread where the circumstances of this fix are explained?

It would really help if I could understand what's going on with this bug.

Thanks,
Chris
Comment 13 Simon Baatz 2024-01-20 13:27:21 UTC
Hi Chris,

it's ad1220bb4bcfd ("wifi: iwlwifi: pcie: don't synchronize IRQs from IRQ"). However, it should also be part of 6.7 (400f6ebbc175286576c7f7fddf3c347d09d12310). I just realized that, although this bug report has very similar symptoms to the ones I experienced, it is about much more recent hardware (I have an ancient 8265/8275). So, the cause might be completely unrelated.

Best,
Simon
Comment 14 chris 2024-01-21 02:30:04 UTC
Hi Simon,

Thank you for providing those references.

I looked at the commit you mentioned, `400f6ebbc175286576c7f7fddf3c347d09d12310` (https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=400f6ebbc175286576c7f7fddf3c347d09d12310), which indeed refers to a fix for older devices, with the description stating "On older devices (before unified image!) we can end up calling stop_device from an rfkill interrupt."

Given that the AX210 is a more recent device, it seems that the symptoms we're seeing might be different.

As for `ad1220bb4bcfd`, I've had some trouble locating that.

Best,
Chris
Comment 15 chris 2024-01-23 08:27:25 UTC
Hi Adam,

On https://community.intel.com/t5/Wireless/AX210-System-Crash-after-iwlwifi-Queue-Stuck-Error-Issue/m-p/1562147, a Customer Support Technician there, Jose B., suggested updating the BIOS to the latest version as a possible solution to our issue.

I went ahead and updated my BIOS to the latest release as recommended.

Considering the sporadic nature of the crashes, it can be tough to confirm if the BIOS update helps within the seven-day window given by Intel's policy.

I noticed that your BIOS isn't current either. If you could update it too, we could improve our chances of catching any system behavior changes after the update.

Please keep me posted.

Best,
Chris
Comment 16 Adam 2024-01-25 02:45:46 UTC
Hi Chris,

Thanks for the heads up. I've updated my BIOS and will report back if I encounter any related issues!

For reference, my current setup:

$ hostnamectl
     Static hostname: (unset)                             
  Transient hostname: fedora
    Operating System: Fedora Linux 39.20240124.0 (Kinoite)
         CPE OS Name: cpe:/o:fedoraproject:fedora:39
              Kernel: Linux 6.6.12-200.fc39.x86_64
        Architecture: x86-64
     Hardware Vendor: ASUS
      Hardware Model: ROG STRIX X670E-E GAMING WIFI
    Firmware Version: 1807
       Firmware Date: Thu 2023-12-14
Comment 17 chris 2024-01-26 04:34:20 UTC
Hi Adam,

As far as I'm concerned the bug is still showing up:

```
$ hostnamectl 
 Static hostname: nixos
       Icon name: computer-desktop
         Chassis: desktop 🖥
Operating System: NixOS 24.05 (Uakari)            
          Kernel: Linux 6.7.1
    Architecture: x86-64
 Hardware Vendor: ASUS
  Hardware Model: ROG STRIX X670E-E GAMING WIFI
Firmware Version: 1807
   Firmware Date: Thu 2023-12-14
```

```
$ journalctl -b -1
...
Jan 26 03:24:55 nixos kernel: iwlwifi 0000:08:00.0: Queue 4 is stuck 39108 39109
Jan 26 03:25:00 nixos kernel: sched: RT throttling activated
Jan 26 03:25:11 nixos bluetoothd[1059]: profiles/audio/avdtp.c:cancel_request() Suspend: Connection timed out (110)
Jan 26 03:25:16 nixos kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
Jan 26 03:25:16 nixos kernel: rcu:         0-....: (8 GPs behind) idle=d6bc/1/0x4000000000000002 softirq=3077933/3077934 fqs=5080
Jan 26 03:25:16 nixos kernel: rcu:         (detected by 3, t=21002 jiffies, g=14745593, q=886 ncpus=12)
```

As usually the computer was frozen and I had to use the power button.

I'll report that to community.intel.com.

On a different note, they say here https://www.kernel.org/doc/html/v5.16/admin-guide/reporting-issues.html:

"most of the time this won’t be bugzilla.kernel.org, as issues typically need to be sent by mail to a maintainer and a public mailing list."

I guess we'll have to figure out how all that really work, because neither here nor on community.intel.com are we receiving any help. But it has the important positive side of keeping the thing open.

Best,
Chris
Comment 18 Adam 2024-01-27 03:01:52 UTC
Hi Chris,

According to the MAINTAINERS file in the backport-iwlwifi repository, the maintainer of iwlwifi is the following:

https://git.kernel.org/pub/scm/linux/kernel/git/iwlwifi/backport-iwlwifi.git/tree/MAINTAINERS#n10964

INTEL WIRELESS WIFI LINK (iwlwifi)
M:	Gregory Greenman <gregory.greenman@intel.com>
L:	linux-wireless@vger.kernel.org
S:	Supported
W:	https://wireless.wiki.kernel.org/en/users/drivers/iwlwifi
T:	git git://git.kernel.org/pub/scm/linux/kernel/git/iwlwifi/iwlwifi.git
F:	drivers/net/wireless/intel/iwlwifi/

Perhaps this is our point of contact?
Comment 19 chris 2024-01-30 03:09:42 UTC
Hi Adam,

Thanks for the contact details for the `iwlwifi` maintainer.

Have you considered filing a bug report for Fedora. I think it would be a great idea.

On https://www.kernel.org/doc/html/v5.16/admin-guide/reporting-issues.html they say:
"Are you facing an issue with a Linux kernel a hardware or software vendor provided? Then in almost all cases you are better off to stop reading this document and reporting the issue to your vendor instead, unless you are willing to install the latest Linux version yourself. Be aware the latter will often be needed anyway to hunt down and fix issues."

Fedora is a "vendor" there I guess. (I do have the latest Linux kernel too now that I think of it.)

Based on some chat with @K900 from nixos, I'm understand that the `rcu_preempt` error and system hang-ups we're experiencing might be due to the Wi-Fi adapter "holding the bus". 

I'm going to report our issue to the `linux-wireless` mailing list with `cc` to Gregory Greenman. This might not yield immediate fixes, but we must share our experiences otherwise nothing will happen.

We should do the Fedora bug report as it could greatly improve visibility.

Best,  
Chris
Comment 20 Adam 2024-01-31 03:27:49 UTC
Hey Chris,

I've logged the following bug with Fedora: https://bugzilla.redhat.com/show_bug.cgi?id=2262044

Looking forward to hearing if you get a response from Gregory!

Thanks
Adam
Comment 21 chris 2024-02-03 22:19:14 UTC
Hi Adam,

https://lore.kernel.org/linux-wireless/2494913.iZASKD2KPV@nixos/

Surely it can do no harm.

Best,
Chris
Comment 22 chris 2024-02-06 01:47:33 UTC
Hi Adam,

There has been a new message on community.intel.com. It's from Isaac.
He suggests three possible approaches.
The first and second consist in seeing if improvement can come from tweaking 'PCIe power save' or 'PCIe ASPM (Active State Power Management)'.

Concerning the third alternative I prefer to directly quote Isaac, because I don't have a complete grasp of what it means:

"Load the branch core83 from backport-iwlwifi https://git.kernel.org/pub/scm/linux/kernel/git/iwlwifi/backport-iwlwifi.git/, and switch to the branch".

Concerning that latter approach I think I'm already ahead of it, my firmware is newer that the suggested backport.

The newest suggested firmware backport is from 2023-12-20 but my firmware is the one tagged 20240115 here https://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git/log/.
As evidence from
```
$ nix-store --query --requisites /run/current-system | grep -i linux-firmware
/nix/store/r77d9y4qsilx8sr62zk4x3w3j16029gj-linux-firmware-20240115-xz
```
And
```
$ history | grep '^[^[:alpha:]]*sudo nixos-rebuild boot --upgrade' | tail -n1 | awk '{print $2}'
2024-01-23
```
And
```
https://github.com/NixOS/nixpkgs/blob/479ba708b0932deeac25062919817e10b85db816/pkgs/os-specific/linux/firmware/linux-firmware/source.nix
```
So my firmware is, if I'm not mistaken, newer than the suggested firmware.
So I've indirectly followed option #3, and still I've had one crash there, three days after the upgrade:
```
$ journalctl -b -1
...
Jan 26 03:24:55 nixos kernel: iwlwifi 0000:08:00.0: Queue 4 is stuck 39108 39109
Jan 26 03:25:00 nixos kernel: sched: RT throttling activated
Jan 26 03:25:11 nixos bluetoothd[1059]: profiles/audio/avdtp.c:cancel_request() Suspend: Connection timed out (110)
Jan 26 03:25:16 nixos kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
Jan 26 03:25:16 nixos kernel: rcu:         0-....: (8 GPs behind) idle=d6bc/1/0x4000000000000002 softirq=3077933/3077934 fqs=5080
Jan 26 03:25:16 nixos kernel: rcu:         (detected by 3, t=21002 jiffies, g=14745593, q=886 ncpus=12)
```

I understand from your bug report on Fedora that you are able to reproduce the bug?
You could try the option #1 which seems promising, and see if there is an observable improvement.

I didn't answer yet to Isaac because it gives us more time to see if something works or doesn't before answering.

Best,
Chris
Comment 23 Adam 2024-02-06 03:37:30 UTC
Hey Chris,

I am trying to make sense of and compare the git commits of `linux-firmware` to `backport-iwlwifi`. There are several commit logs in `linux-firmware` referencing iwlwifi and the core83 branch. The most recent git log referencing branch core83 was on 2023-11-16. But, there have been 3 additional commits to the core83 branch in `backport-iwlwifi` on 2023-11-19. I'm unable to determine if the changes in those 3 commits would be related to our issue though. I only mention this because it's possible the firmware version you have installed is missing these 3 commits. I may not understand the release process though...

Regardless, I read through Issac's reply earlier today, as well as the ASPM documentation he provided. I will try and test this as soon as I can. My PC is unfortunately disconnected for a bit as we are doing some work in our house. I may not be able to get to it until some time next week sadly.

Regarding my ability to reproduce the issue. I cannot promise that I can regularly reproduce, but it seems like I've run into this issue many times when running longer downloads, such as a large ISO, game downloads via Steam, etc. Have you noticed a pattern like this?

Thanks,
Adam
Comment 24 chris 2024-02-06 21:17:32 UTC
Hi Adam,

Below is a draft of what I (we) could send Isaac in a few days, so we get a little bit more time to assess the suggested solutions.

Good luck with your house,
Best,
Chris

Note: I also must have a look at the documentation pointed to by Isaac:
https://wireless.wiki.kernel.org/en/users/documentation/aspm
And there are interesting git repos here:
https://wireless.wiki.kernel.org/en/users/drivers/iwlwifi
to try to make sense of the commits.

---

Hi Isaac,

I've dedicated considerable effort to understanding whether your recommended backport contains updates beyond what is covered in my current setup, which includes kernel 6.7.1 and the `loaded firmware version 86.fb5c9aeb.0 ty-a0-gf-a0-86.ucode op_mode iwlmvm`. From what I can ascertain, my firmware appears to be on par with or perhaps ahead of the backport you suggested. However, I must concede that my grasp of the nuances within kernel and iwlwifi commit logs is rather limited, so there's a chance I could be missing finer details.

Kernel and iwlwifi changelogs are notably compact and technical, making it challenging for me to discern the practical implications of each update or modification.

Regarding Adam's configuration and kernel version, he might indeed find the suggested backport more advantageous. Unfortunately, he has mentioned that he won't have access to his machine for the next 10 days. 

Given these circumstances, I propose we allow some time for Adam to return and assess how he might proceed with the backport in relation to his setup.

Thank you for your understanding and patience as we navigate these technical challenges. I'll ensure to keep you updated with our progress.

Best regards,
Chris
Comment 25 Adam 2024-02-11 15:35:40 UTC
Hi Chris, sorry for the delay. I had some good results with Option #1 that Issac recommended. I've replied to the issue on the Intel thread directly. I'll paste my reply here as well for traceability.

`````
Hello All,


I'm sorry for the delay, I was able to spend some time with this yesterday and have some results to report back on.


I setup my test case in a way that I was hoping I would be able to confirm that I not only could reproduce the issue, but that I could be fairly certain of my results after applying one of the options laid out by Issac above.


In order to reproduce, I chose a game on Steam that was >100GB to download. I started the download and started tailing the journal log. After ~20GB of data downloaded, I saw our "queue stuck" error, and the system quickly degraded to a hang and other "soft lockup" messages started reporting to the log. Let me know if these logs would be helpful. I can provide details if you'd like.


After a forced reboot, I decided to start with Option #1 above, which is to disable ASPM leaving only L0 enabled. After confirming 0x50.B was indeed the Link Control Register (by using the algorithm in the documentation Issac sent) I ran the following command to disable ASPM:

`sudo setpci -s 0a:00.0 0x50.B=0x40`

After confirming that ASPM was indeed disabled via `lspci -s 0a:00.0 -vvv`, I restarted my download, and began tailing the journal log once again. I was able to download all 112GB of data without any "queue stuck" error! Just to be sure though, I repeated the entire download a second time with the same results, no issues. I will continue to run with ASPM disabled in case I just "got lucky" through those 224GB of data. I'll surely report back if I see any issues.


I assume with this outcome, Option #2 would produce the same results, given I would be disabling ASPM via the BIOS. Is that a safe assumption?


Is Option #3 still worth exploring? As Chris stated above, I am not familiar with the details of the iwlwifi release management process, how exactly changes from backport-iwlwifi are merged, etc. So it's tough for me to tell if the version of iwlwifi Chris is running contains all the relevant commits from the core83 branch that Issac mentions.


Please let me know if there are any other test cases you'd like me run! Hope this outcome helps!


Thanks

Adam
Comment 26 chris 2024-02-12 05:24:56 UTC
Hi Adam,

Thank you for your update and for trying Isaac’s recommendations on the Intel forum. Your methodical approach and the positive results with Option #1 are encouraging. Great job pinpointing a potential solution!

I experienced another crash today, despite my setup aligning with Isaac’s Option #3, given the recency of my kernel and firmware version. Here are the details of the crash for reference:

```
** Hostnamectl **
 Static hostname: nixos
Operating System: NixOS 24.05 (Uakari)
          Kernel: Linux 6.7.1
    Architecture: x86-64
 Hardware Vendor: ASUS
  Hardware Model: ROG STRIX X670E-E GAMING WIFI
Firmware Version: 1807
   Firmware Date: Thu 2023-12-14

** Firmware Version **
Feb 12 02:57:59 nixos kernel: iwlwifi 0000:08:00.0: loaded firmware version 86.fb5c9aeb.0 ty-a0-gf-a0-86.ucode op_mode iwlmvm

** Error Log **
Feb 12 02:56:37 nixos kernel: iwlwifi 0000:08:00.0: Queue 4 is stuck 2889 2907
Feb 12 02:56:58 nixos kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
Feb 12 02:56:58 nixos kernel: rcu:         9-....: (13 GPs behind) idle=481c/1/0x4000000000000002 softirq=17442062/17442062 fqs=5060
Feb 12 02:56:58 nixos kernel: rcu:         (detected by 7, t=21002 jiffies, g=74234793, q=871 ncpus=12)
```

Inspired by your strategy, I'm planning to attempt a similar large file download to assess reproducibility on my end:

```
wget -O /dev/null http://speedtest.tele2.net/100GB.zip
```

Should this test indicate reproducibility, I will then implement Isaac’s Option #1, mirroring your successful mitigation steps. This appears to be a promising avenue for alleviating the issue, at least temporarily.

Best,  
Chris
Comment 27 chris 2024-02-14 00:59:36 UTC
Hi Adam,

Following your lead, I undertook the test you suggested to replicate the iwlwifi crash scenario. Specifically, I initiated a large file download via:

```
wget -O /dev/null http://speedtest.tele2.net/100GB.zip
```

Interestingly, the test yielded significant insights on two separate occasions:

1. **First Attempt**: Approximately two-thirds through the download, I encountered a partial replication of the known issue:
    ```
    iwlwifi 0000:08:00.0: Queue 3 is stuck 59143 59146
    ```
    This time, however, the system did not fully crash due to the absence of `rcu_preempt detected stalls on CPUs/tasks`. Instead, only the wifi adapter crashed. A system reboot was required to reset the adapter, as I'm unaware of any alternative method to recover its functionality.

2. **Second Attempt**: The system endured a complete crash and spontaneously rebooted after just 9% of the download:
    ```
    Feb 13 13:20:26 nixos kernel: iwlwifi 0000:08:00.0: Error sending SCAN_CFG_CMD: time out after 2000ms.
    Feb 13 13:20:26 nixos kernel: iwlwifi 0000:08:00.0: Current CMD queue read_ptr 42752 write_ptr 42753
    Feb 13 13:20:34 nixos kernel: iwlwifi 0000:08:00.0: Queue 3 is stuck 52081 52088
    Feb 13 13:20:48 nixos kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
    Feb 13 13:20:48 nixos kernel: rcu:         0-....: (108 ticks this GP) idle=699c/1/0x4000000000000000 softirq=995773/995773 fqs=5175
    Feb 13 13:20:48 nixos kernel: rcu:         (detected by 10, t=21004 jiffies, g=4918913, q=135 ncpus=12)
    ```
    The outcomes suggest a strong reproducibility factor for the bug, reflecting both the wifi adapter and full system crashes.

Given these results, I am considering another round of tests to further solidify our understanding. Subsequently, I plan to implement the mitigation strategy you shared, based on disabling ASPM, to assess its impact on system stability.

Your approach to identifying a viable workaround has been very helpful. I'll keep you updated.

Best,  
Chris
Comment 28 chris 2024-02-14 04:20:43 UTC
Hi Adam,

We've already got a reply from Alberto R., Intel Customer Support Technician.

He says:
"After further review of this case, we would like to let you know that in this scenario the next thing to do will be to get in contact directly with ASUS Support for further assistance as AMD is not compatible with the Operating System, therefore there is a limitation we can't address."

I'm a bit struggling to make sense of it, especially the part where he say: "AMD is not compatible with the Operating System"?

What operation system?

How do they know AMD is not compatible since they are Intel?

Best,
Chris
Comment 29 chris 2024-02-14 09:30:10 UTC
Hi Adam,

Apparently we can't even reply to the nonsensical post from Alberto R.

They are very rude.

Best,
Chris
Comment 30 Adam 2024-02-15 03:31:29 UTC
Hey Chris,

Yes I agree. "Nonsensical" is a good way to describe the reply that we got from Alberto R... I'm not quite sure how to proceed here. Perhaps he's saying that this requires a BIOS update from ASUS, given ASPM is negotiated by the BIOS. Though his reply is very confusing as it doesn't mention Intel (the manufacturer of the wireless adapter we're troubleshooting), and instead references AMD(?) and the operating system (Linux?). Nonsensical...

Perhaps it's worth opening a separate issue with Intel that references the closed thread, asking for a response that actually makes sense :)

Curious what your thoughts are on next steps?

Thanks
Adam
Comment 31 silver21278 2024-02-15 19:24:32 UTC
Hi all,

I have been having very much the same problem 

 Static hostname: archlinux
       Icon name: computer-desktop
         Chassis: desktop 🖥
      Machine ID: 2c2913560c3b462abcf273b35823d77f
         Boot ID: c7bc83e8a6924224bfed5f7492ec3186
Operating System: Arch Linux                      
          Kernel: Linux 6.7.4-arch1-1
    Architecture: x86-64
 Hardware Vendor: ASUS
  Hardware Model: ROG STRIX X670E-E GAMING WIFI
Firmware Version: 1416
   Firmware Date: Tue 2023-05-16
    Firmware Age: 9month 1d

***Journalctl output***
Feb 15 12:49:17 archlinux kernel: Code: 0f ba 2b 08 0f 92 c2 8b 03 0f b6 d2 c1 e2 08 30 e4 09 d0 3d ff 00 00 00 77 5b 85 c0 74 10 0f b6 03 84 c0 74 09 f3 90 0f b6 03 <84> c0 75 f7 b8 01 00 00 00 66 89 03 65 48 ff 05 23 3c c4 56 5b 5d
Feb 15 12:49:17 archlinux kernel: RIP: 0010:native_queued_spin_lock_slowpath+0x71/0x2e0
Feb 15 12:49:17 archlinux kernel: Hardware name: ASUS System Product Name/ROG STRIX X670E-E GAMING WIFI, BIOS 1416 05/16/2023
Feb 15 12:49:17 archlinux kernel: CPU: 0 PID: 0 Comm: swapper/0 Not tainted 6.7.4-arch1-1 #1 20d30c48b78a04be2046f4b305b40455f0b5b38b
Feb 15 12:49:17 archlinux kernel:  wmi gpio_generic mac_hid pkcs8_key_parser i2c_dev crypto_user fuse dm_mod loop nfnetlink zram ip_tables x_tables ext4 crc32c_generic crc16 mbcache jbd2 usbhid crc32c_intel nvme xhci_pci nvme_core xhci_pci_renesas nvme_auth
Feb 15 12:49:17 archlinux kernel: Modules linked in: uinput rfcomm snd_seq_dummy snd_hrtimer snd_seq ccm algif_aead crypto_null des3_ede_x86_64 cbc des_generic libdes md4 cmac algif_hash algif_skcipher af_alg bnep intel_rapl_msr intel_rapl_common edac_mce_amd snd_usb_audio snd_usbmidi_lib kvm_amd snd_ump snd_rawmi>
Feb 15 12:49:17 archlinux kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [swapper/0:0]
Feb 15 12:48:56 archlinux kernel: iwlwifi 0000:0b:00.0: Queue 3 is stuck 61213 61439
Feb 15 12:48:51 archlinux kernel: iwlwifi 0000:0b:00.0: Current CMD queue read_ptr 1610 write_ptr 1611
Feb 15 12:48:51 archlinux kernel: iwlwifi 0000:0b:00.0: Error sending SYSTEM_STATISTICS_CMD: time out after 2000ms.
***Journalctl output ***

According to Journalctl it appears it might be a hardware issue? I went into my bios and turned off something around CPU ASPM management. 
I ran `sudo setpci -s 0a:00.0 0x50.B=0x40` like you all suggested all will let you all known if it fixes the issue.

I have been having this problem essentially since I bought this computer in June of last year so I am inclined to believe this is a problem with the firmware itself.
Comment 32 chris 2024-02-15 22:51:22 UTC
Hi Adam,

I agree, the response from Alberto .R is very frustrating. It's annoying not only because it detours from our technical discussion but also in the way it abruptly limits our communication channels on the forum.

It seems like we're being indirectly told that our pursuit for clarity and assistance is no longer welcome there, which is quite disappointing.

Creating a separate issue with Intel, as you suggested, might indeed be a path worth considering. However, there's no guarantee they'd let us speak at all. But I think we must try to maintain visibility on this issue.

I'm unsure of the best way to regain a discussion with Intel. I'm open to ideas and ready to support any moves that might help us. Whether it's through alternative forums, direct outreach, or community support, keeping the conversation alive and seeking visibility is crucial.

Best,
Chris
Comment 33 chris 2024-02-15 23:16:45 UTC
Hi silver21278,

Welcome to the conversation, and thank you for sharing your experience.

I see you have:
```
Feb 15 12:48:56 archlinux kernel: iwlwifi 0000:0b:00.0: Queue 3 is stuck 61213 61439
```

How does you system behave following that error?

Wifi getting slow? System getting slow? Wifi crash? Wifi recovers? System crash altogether?

Do you have some
```
rcu: INFO: rcu_preempt detected stalls on CPUs/tasks
```
at some point?

In any case, your system being identical to mine and Adam's, it's probably related.

I too have had that same issue since I bought the computer.

I too think it's a wifi firmware related problem.

Best,
Chris
Comment 34 Adam 2024-02-16 02:24:47 UTC
Hi silver21278,

It may be important to note that the `sudo setpci -s 0a:00.0 0x50.B=0x40` command is specific to the PCIE bus that my wifi adapter is on. Your PCIE bus address will likely be different. I'm fairly certain that it corresponds to the address listed in the iwlwifi journalctl log statements, but following the algorithm in this ASPM documentation is probably your best bet to be certain: https://wireless.wiki.kernel.org/en/users/documentation/aspm

If my suspicions are correct, the command you should be running is `sudo setpci -s 0b:00.0 0x50.B=0x40` to disable ASPM for your adapter. Note that the bus address in this command was changed to "0b:00.0".

I'm also interested in your responses to the questions that chris posed.

Thanks
Adam
Comment 35 Adam 2024-02-16 02:56:34 UTC
Hey Chris,

I have created a follow up post on the Intel Community forum asking for clarifications on the "resolution" we received. Please feel free to add any questions that you'd like to ask: https://community.intel.com/t5/Wireless/Follow-up-AX210-System-Crash-after-iwlwifi-Queue-Stuck-Error/m-p/1572778#M52529

Here's to hoping we get some clear answers!
Adam
Comment 36 chris 2024-02-16 06:55:49 UTC
Hi Adam,

I just read your latest post on the Intel Community forum, and I have to say, you nailed it!

Thanks a lot for taking the initiative and putting together such an awesome follow-up.

Best,
Chris
Comment 37 silver21278 2024-02-16 18:43:48 UTC
Hi Chris, in the immediate aftermath it causes a complete freeze. I have to completely restart the computer. Also I do not know if it is related but sometimes the wifi device will completely vanish off the system and require a restart.


Also during boot I get this error: 

Feb 16 13:22:53 archlinux kernel: iwlwifi 0000:0b:00.0: WRT: Invalid buffer destination

Adam in terms of stalls I get some errors like:
watchdog: BUG: soft lockup - CPU#28 stuck for 26s! [NetworkManager:835]

I ran the right command you suggested and will let you know if it works.

Though behavior has varied when the error in question happens. Sometimes the system recovers successfully or other times freezes over the course of a few minutes with performace degrading over time till I am forced to restart.
Comment 38 chris 2024-02-17 03:28:48 UTC
Hi silver21278,

Thank you for the update. It's helpful to know that the problem leads to a complete freeze at times and that the Wi-Fi device can vanish, necessitating a restart. These symptoms align with what Adam and I have been experiencing.

Regarding the `iwlwifi 0000:0b:00.0: WRT: Invalid buffer destination` error during boot, this message is commonly seen across various systems and doesn't indicate a problem. It's a known message that appears in the logs but doesn't have consequences.

It would be helpful if you could check for any `rcu: INFO: rcu_preempt detected stalls on CPUs/tasks` messages in your `journalctl` logs. Could you try the following command and share the output?

```bash
journalctl --list-boots --output=export | tail -n15 | awk '{print $2}' | xargs -n1 journalctl --no-pager -b | grep rcu_preempt
```

Best,
Chris
Comment 39 silver21278 2024-02-18 17:29:34 UTC
Hi Chris,


The first command outputted:
d0487db98d634c488879586ee529010c
9b53e10af19c4aceb43258823281ebf2
6161da981acb40dd9a55782b0711d633
c7bc83e8a6924224bfed5f7492ec3186
2f0806fc57334b9a9a73443857206e73
a0089ecd8334483682ecd794020eb44e
b6cbb80c33ee4dad9c31d403d9136748
1f7e059743cd463199bed8251f4f84dd
3fb537729ef6487897c9edddcf722fc3
e174a703f78149f2be442cae09aeeed6
8addd5e0f2e2494bacd008c92e11f3b0
e11c8ef3caa14a148ac744b70d71611e
6b128e10c23346ffb79a8ff58be24d9c
febe96aea01a4f778a5cfb24e1380fe3
26a9626c54354155bf614e5d629abdba
The second command outputted nothing however
Comment 40 chris 2024-02-19 06:05:02 UTC
Hi silver21278,

I apologize for the confusion caused by my last message. The command I shared was inadvertently split into two by the webpage formatting. It was intended to be a single command line. Really sorry for the hiccup.

Below is the same command as the one from previous message, but slightly edited for clarity, ensuring it remains a one-liner, to avoid the confusion from the previous formatting issue.

```bash
journalctl --list-boots --output=export | tail -n15 | awk '{print $2}' | \
xargs -n1 journalctl --no-pager -b | grep rcu_preempt
```

This command is meant to search through the logs of your recent system boots for any specific messages that mention `rcu_preempt`, which would really help concerning the issue. 

Can you please run this edited version and share the output? It really is helping.

Thanks again and really sorry for the confusion I created.

Best,
Chris
Comment 41 silver21278 2024-02-27 22:13:00 UTC
Hi Chris,

I ran the whole command still nothing. It seems the fix of disabling the ASPM has worked so far and it has been a while since I have experienced a crash.
Comment 42 chris 2024-02-28 10:25:32 UTC
Hi silver21278,

Thanks for running the command and the update. Great to hear disabling ASPM seems to have worked. It's likely no logs of the crash are available if the system has had several boots since the fix.

If you notice anything else or if crashes resume, please don’t hesitate to reach back out. Your input is really valuable to our understanding and efforts.

Best,
Chris
Comment 43 Adam 2024-03-03 01:59:09 UTC
Hey chris,

I am not sure if you have been following the follow up thread that I created on the Intel Community support forum. It seems that we have some confirmation that this issue does seem to be directly related to the ASPM negotiation. I figured this much based on our testing, but it is nice to get confirmation. The recommendation is to contact ASUS support directly and ask them for assistance in debugging this ASPM negotiation. 

Apparently the only route for initiating a support ticket with ASUS in my country is through chat, which is closed during the "off hours". I am hoping to find time tomorrow afternoon to create a case with them.

In the meantime, I wanted to share a systemd service that I created to disable ASPM on startup. This will not only ensure that ASPM is disabled on the AX210, but also allow for a "toggle" of sorts to re-enable it in order to do testing. I'm not sure if your NixOS system is configured with systemd, but feel free to test this out if you'd like. It may be of use to others while we drive toward a long-term fix with ASUS.

On my system, I have placed this in /usr/local/lib/systemd/system/ax210-aspm.service, but of course any other location that systemd reads services from would also work.

```
[Unit]
Description=ASPM toggle for AX210 iwlwifi

[Service]
Type=oneshot
ExecStart=/bin/bash -c 'setpci -s "$(lspci | awk \'/AX210/{print $1}\')" 0x50.B=0x40'
ExecStop=/bin/bash -c 'setpci -s "$(lspci | awk \'/AX210/{print $1}\')" 0x50.B=0x42'
RemainAfterExit=yes

[Install]
WantedBy=multi-user.target
```

As you can see, this should ensure that the `setpci` command is executed using the PCI-E slot that the AX210 is running on, hopefully in any system. It also re-enables ASPM when stopping the service.

Anyways, let me know if you find this helpful. I will update you with the ASUS case information when I have it.

Thanks
Adam
Comment 44 Adam 2024-03-03 19:15:38 UTC
Hello chris,

Upon talking to ASUS, they notified me of a new BIOS version that we should try (v1905). There is a patch note on v1904 related to system stability, so hopefully it is related to our issue. The agent I spoke to could not confirm this though. If you would be willing to update to the latest BIOS version and see if you can reproduce the issue, that would be very helpful! I will be doing the same.

Here is the open ASUS case #: N2403002688

Looking forward to hearing any feedback!

Thanks
Adam
Comment 45 Adam 2024-03-05 03:25:46 UTC
Hi chris,

I have some interesting observations to share!

After installing BIOS v1905, I disabled my systemd service that would otherwise disable ASPM on boot. This would ensure that upon boot, whatever ASPM level that was negotiated by the BIOS would be used.

Upon boot, I initiated a large download in an effort to reproduce our issue. After about 15 minutes or so, my wireless connection dropped, and I noticed errors flowing into the journal log. I was able to reproduce this several times.

Interestingly, the system never hung or crashed, only lost wireless connectivity. The errors in the journal log are NOT "Queue # stuck" or "soft lockup errors", but instead a new error!

```
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: Error sending SYSTEM_STATISTICS_CMD: time out after 2000ms.
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: Current CMD queue read_ptr 5190 write_ptr 5191
```

The above is from one of my kernel logs after I lost connectivity. Following these errors is call traces, as well as register dumps. I will place the full content at the end of this post.

If you have any time, I would love to understand if you also get the following behavior with BIOS v1905.

Thanks
Adam

------

Here is a large snippet of the content in my journal log when I lose wireless connectivity:

```
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: Error sending SYSTEM_STATISTICS_CMD: time out after 2000ms.
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: Current CMD queue read_ptr 5190 write_ptr 5191
Mar 03 15:31:49 fedora kernel: ------------[ cut here ]------------
Mar 03 15:31:49 fedora kernel: Timeout waiting for hardware access (CSR_GP_CNTRL 0xffffffff)
Mar 03 15:31:49 fedora kernel: WARNING: CPU: 20 PID: 1507 at drivers/net/wireless/intel/iwlwifi/pcie/trans.c:2225 __iwl_trans_pcie_grab_nic_access+0x150/0x160 [iwlwifi]
Mar 03 15:31:49 fedora kernel: Modules linked in: uinput rfcomm snd_seq_dummy snd_hrtimer nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat nf_nat >
Mar 03 15:31:49 fedora kernel:  polyval_generic drm_suballoc_helper drm_display_helper ghash_clmulni_intel sha512_ssse3 cec sha256_ssse3 sha1_ssse3 ccp drm_ttm_helper sp5100_tco ttm video wmi ip6_tables ip_tables fuse i2c_dev
Mar 03 15:31:49 fedora kernel: CPU: 20 PID: 1507 Comm: NetworkManager Not tainted 6.7.6-200.fc39.x86_64 #1
Mar 03 15:31:49 fedora kernel: Hardware name: ASUS System Product Name/ROG STRIX X670E-E GAMING WIFI, BIOS 1905 02/05/2024
Mar 03 15:31:49 fedora kernel: RIP: 0010:__iwl_trans_pcie_grab_nic_access+0x150/0x160 [iwlwifi]
Mar 03 15:31:49 fedora kernel: Code: e8 95 0b 9a eb 31 c0 eb 9b 31 f6 48 89 df e8 07 b6 ff ff eb e8 89 c6 48 c7 c7 b8 86 79 c1 c6 05 a5 0a e7 ff 01 e8 f0 71 a9 ea <0f> 0b eb a7 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90
Mar 03 15:31:49 fedora kernel: RSP: 0018:ffffa8d5013db410 EFLAGS: 00010286
Mar 03 15:31:49 fedora kernel: RAX: 0000000000000000 RBX: ffff95e423770028 RCX: 0000000000000027
Mar 03 15:31:49 fedora kernel: RDX: ffff95f31e5215c8 RSI: 0000000000000001 RDI: ffff95f31e5215c0
Mar 03 15:31:49 fedora kernel: RBP: 00000000ffffffff R08: 0000000000000000 R09: ffffa8d5013db298
Mar 03 15:31:49 fedora kernel: R10: 0000000000000003 R11: ffffffffae546828 R12: 0000000000000001
Mar 03 15:31:49 fedora kernel: R13: 0000000000000011 R14: ffff95e4237735ec R15: 0000000000000000
Mar 03 15:31:49 fedora kernel: FS:  00007f5d214d1540(0000) GS:ffff95f31e500000(0000) knlGS:0000000000000000
Mar 03 15:31:49 fedora kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Mar 03 15:31:49 fedora kernel: CR2: 00007f34dadf9050 CR3: 0000000140208000 CR4: 0000000000f50ef0
Mar 03 15:31:49 fedora kernel: PKRU: 55555554
Mar 03 15:31:49 fedora kernel: Call Trace:
Mar 03 15:31:49 fedora kernel:  <TASK>
Mar 03 15:31:49 fedora kernel:  ? __iwl_trans_pcie_grab_nic_access+0x150/0x160 [iwlwifi]
Mar 03 15:31:49 fedora kernel:  ? __warn+0x81/0x130
Mar 03 15:31:49 fedora kernel:  ? __iwl_trans_pcie_grab_nic_access+0x150/0x160 [iwlwifi]
Mar 03 15:31:49 fedora kernel:  ? report_bug+0x171/0x1a0
Mar 03 15:31:49 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:49 fedora kernel:  ? console_unlock+0x78/0x120
Mar 03 15:31:49 fedora kernel:  ? handle_bug+0x3c/0x80
Mar 03 15:31:49 fedora kernel:  ? exc_invalid_op+0x17/0x70
Mar 03 15:31:49 fedora kernel:  ? asm_exc_invalid_op+0x1a/0x20
Mar 03 15:31:49 fedora kernel:  ? __iwl_trans_pcie_grab_nic_access+0x150/0x160 [iwlwifi]
Mar 03 15:31:49 fedora kernel:  iwl_trans_pcie_grab_nic_access+0x1a/0x40 [iwlwifi]
Mar 03 15:31:49 fedora kernel:  iwl_force_nmi+0xdf/0x110 [iwlwifi]
Mar 03 15:31:49 fedora kernel:  iwl_trans_sync_nmi_with_addr+0x14b/0x170 [iwlwifi]
Mar 03 15:31:49 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:49 fedora kernel:  iwl_trans_txq_send_hcmd+0x401/0x450 [iwlwifi]
Mar 03 15:31:49 fedora kernel:  ? __pfx_autoremove_wake_function+0x10/0x10
Mar 03 15:31:49 fedora kernel:  iwl_trans_send_cmd+0x66/0x100 [iwlwifi]
Mar 03 15:31:49 fedora kernel:  iwl_mvm_send_cmd+0x1f/0x60 [iwlmvm]
Mar 03 15:31:49 fedora kernel:  iwl_mvm_request_system_statistics+0xc9/0x180 [iwlmvm]
Mar 03 15:31:49 fedora kernel:  iwl_mvm_request_statistics+0x8c/0x1d0 [iwlmvm]
Mar 03 15:31:49 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:49 fedora kernel:  iwl_mvm_mac_sta_statistics+0x18b/0x3c0 [iwlmvm]
Mar 03 15:31:49 fedora kernel:  sta_set_sinfo+0xde/0xc30 [mac80211]
Mar 03 15:31:49 fedora kernel:  ieee80211_dump_station+0x47/0x60 [mac80211]
Mar 03 15:31:49 fedora kernel:  nl80211_dump_station+0x13f/0x290 [cfg80211]
Mar 03 15:31:49 fedora kernel:  genl_dumpit+0x33/0x90
Mar 03 15:31:49 fedora kernel:  netlink_dump+0x126/0x320
Mar 03 15:31:49 fedora kernel:  __netlink_dump_start+0x1d6/0x290
Mar 03 15:31:49 fedora kernel:  genl_family_rcv_msg_dumpit+0x9c/0x100
Mar 03 15:31:49 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:49 fedora kernel:  ? __pfx_genl_start+0x10/0x10
Mar 03 15:31:49 fedora kernel:  ? __pfx_genl_dumpit+0x10/0x10
Mar 03 15:31:49 fedora kernel:  ? __pfx_genl_done+0x10/0x10
Mar 03 15:31:49 fedora kernel:  genl_rcv_msg+0x146/0x2c0
Mar 03 15:31:49 fedora kernel:  ? __pfx_nl80211_dump_station+0x10/0x10 [cfg80211]
Mar 03 15:31:49 fedora kernel:  ? __pfx_genl_rcv_msg+0x10/0x10
Mar 03 15:31:49 fedora kernel:  netlink_rcv_skb+0x58/0x110
Mar 03 15:31:49 fedora kernel:  genl_rcv+0x28/0x40
Mar 03 15:31:49 fedora kernel:  netlink_unicast+0x1a3/0x290
Mar 03 15:31:49 fedora kernel:  netlink_sendmsg+0x254/0x4d0
Mar 03 15:31:49 fedora kernel:  ____sys_sendmsg+0x396/0x3d0
Mar 03 15:31:49 fedora kernel:  ? copy_msghdr_from_user+0x7d/0xc0
Mar 03 15:31:49 fedora kernel:  ___sys_sendmsg+0x9a/0xe0
Mar 03 15:31:49 fedora kernel:  __sys_sendmsg+0x7a/0xd0
Mar 03 15:31:49 fedora kernel:  do_syscall_64+0x61/0xe0
Mar 03 15:31:49 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:49 fedora kernel:  ? syscall_exit_to_user_mode+0x2b/0x40
Mar 03 15:31:49 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:49 fedora kernel:  ? do_syscall_64+0x70/0xe0
Mar 03 15:31:49 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:49 fedora kernel:  ? do_syscall_64+0x70/0xe0
Mar 03 15:31:49 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:49 fedora kernel:  ? syscall_exit_to_user_mode+0x2b/0x40
Mar 03 15:31:49 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:49 fedora kernel:  ? do_syscall_64+0x70/0xe0
Mar 03 15:31:49 fedora kernel:  ? do_syscall_64+0x70/0xe0
Mar 03 15:31:49 fedora kernel:  ? do_syscall_64+0x70/0xe0
Mar 03 15:31:49 fedora kernel:  entry_SYSCALL_64_after_hwframe+0x6e/0x76
Mar 03 15:31:49 fedora kernel: RIP: 0033:0x7f5d2260eb6b
Mar 03 15:31:49 fedora kernel: Code: 48 89 e5 48 83 ec 20 89 55 ec 48 89 75 f0 89 7d f8 e8 b9 2e f7 ff 8b 55 ec 48 8b 75 f0 41 89 c0 8b 7d f8 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 2d 44 89 c7 48 89 45 f8 e8 11 2f f7 ff 48 8b
Mar 03 15:31:49 fedora kernel: RSP: 002b:00007ffcf7aa0850 EFLAGS: 00000293 ORIG_RAX: 000000000000002e
Mar 03 15:31:49 fedora kernel: RAX: ffffffffffffffda RBX: 0000560aa57292a0 RCX: 00007f5d2260eb6b
Mar 03 15:31:49 fedora kernel: RDX: 0000000000000000 RSI: 00007ffcf7aa0890 RDI: 000000000000000b
Mar 03 15:31:49 fedora kernel: RBP: 00007ffcf7aa0870 R08: 0000000000000000 R09: 0000000000000001
Mar 03 15:31:49 fedora kernel: R10: 0000000000000003 R11: 0000000000000293 R12: 0000560aa57f26f0
Mar 03 15:31:49 fedora kernel: R13: 00007ffcf7aa0920 R14: 0000560aa57292a0 R15: 00007ffcf7aa0b74
Mar 03 15:31:49 fedora kernel:  </TASK>
Mar 03 15:31:49 fedora kernel: ---[ end trace 0000000000000000 ]---
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: iwlwifi transaction failed, dumping registers
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: iwlwifi device config registers:
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 00000000: 27258086 00100000 0280001a 00000000 00000004 00000000 00000000 00000000
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 00000020: 00000000 00000000 00000000 00248086 00000000 000000c8 00000000 00000100
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 00000040: 00028010 10008ec0 001b0c10 0045e812 10120000 00000000 00000000 00000000
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 00000060: 00000000 00080812 00000005 00000006 00000002 00000000 00000000 00000000
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 00000080: 000f0011 00002000 00003000 00000000 00000000 00000000 00000000 00000000
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 000000a0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 000000c0: 00000000 00000000 c823d001 0d000008 00804005 00000000 00000000 00000000
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 000000e0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 00000100: 14c10001 00100000 00000000 00462031 00003100 00002000 00000014 40001001
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 00000120: 0000000f 80000460 00000000 00000000 00000000 00000000 00000000 00000000
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 00000140: 14c00000 ff000000 000000ff 15410018 00000000 0001001e 00481e1f 00000000
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: iwlwifi device memory mapped registers:
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 00000000: ffffffff ffffffff ffffffff ffffffff ffffffff ffffffff ffffffff ffffffff
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 00000020: ffffffff ffffffff ffffffff ffffffff ffffffff ffffffff ffffffff ffffffff
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: iwlwifi device AER capability structure:
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 00000000: 14c10001 00100000 00000000 00462031 00003100 00002000 00000014 40001001
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 00000020: 0000000f 80000460 00000000
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: iwlwifi parent port (0000:08:04.0) config registers:
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:08:04.0: 00000000: 43f51022 00100407 06040001 00010010 00000000 00000000 000a0a08 800001f1
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:08:04.0: 00000020: 80008000 0001fff1 00000000 00000000 00000000 00000050 00000000 001201ff
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:08:04.0: 00000040: 00000000 00000000 00000000 00000000 00817005 fee00000 00000000 00000000
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:08:04.0: 00000060: 00000000 00000000 00000000 00000000 c8238001 00000000 00000000 00000000
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:08:04.0: 00000080: 0162c010 00008022 0005291f 007ae813 70120042 00000d00 01480000 00000000
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:08:04.0: 000000a0: 00000000 00010800 00000000 01870e0e 00000004 00000000 00000000 00000000
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:08:04.0: 000000c0: 0000000d 33281b21 00000000 00000000 00000000 00000000 00000000 00000000
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:08:04.0: 000000e0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:08:04.0: 00000100: 1c010001 00000000 00400000 00462030 000000c0 0000e000 00000000 00000000
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:08:04.0: 00000120: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:08:04.0: 00000140: 00000000 00000000 00000000 00000000 1801000d 0000005f 00000000 00000000
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:08:04.0: 00000160: 1c010018 00000000 00000000 00000000 00000000 00000000 00000000 00000000
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:08:04.0: 00000180: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:08:04.0: 000001a0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:08:04.0: 000001c0: 20010019 00000000 00000000 73787378 73787378 00000000 00000000 00000000
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:08:04.0: 000001e0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:08:04.0: 00000200: 2201001e 0079801f 41168000
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: HW error, resetting before reading
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: Loaded firmware version: 86.fb5c9aeb.0 ty-a0-gf-a0-86.ucode
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | ADVANCED_SYSASSERT          
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | trm_hw_status0
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | trm_hw_status1
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | branchlink2
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | interruptlink1
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | interruptlink2
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | data1
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | data2
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | data3
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | beacon time
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | tsf low
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | tsf hi
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | time gp1
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | time gp2
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | uCode revision type
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | uCode version major
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | uCode version minor
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | hw version
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | board version
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | hcmd
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | isr0
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | isr1
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | isr2
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | isr3
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | isr4
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | last cmd Id
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | wait_event
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | l2p_control
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | l2p_duration
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | l2p_mhvalid
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | l2p_addr_match
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | lmpm_pmg_sel
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | timestamp
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | flow_handler
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | ADVANCED_SYSASSERT
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | umac branchlink1
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | umac branchlink2
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | umac interruptlink1
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | umac interruptlink2
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | umac data1
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | umac data2
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | umac data3
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | umac major
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | umac minor
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | frame pointer
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | stack pointer
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | last host cmd
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | isr status reg
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: IML/ROM dump:
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x5A5A | IML/ROM SYSASSERT
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x5A5A5A5A | IML/ROM error/state
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x5A5A5A5A | IML/ROM data1
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: 0x5A5A5A5A | IML/ROM WFPM_AUTH_KEY_0
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: WRT: Collecting data: ini trigger 4 fired (delay=0ms).
Mar 03 15:31:49 fedora kernel: ieee80211 phy0: Hardware restart was requested
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: WRT: Failed to dump region: id=1, type=10
Mar 03 15:31:49 fedora kernel: iwlwifi 0000:0a:00.0: WRT: Failed to dump region: id=2, type=11
Mar 03 15:31:50 fedora kernel: iwlwifi 0000:0a:00.0: Failed to get monitor header
Mar 03 15:31:50 fedora kernel: iwlwifi 0000:0a:00.0: WRT: Failed to fill region header: id=16, type=2
Mar 03 15:31:50 fedora kernel: iwlwifi 0000:0a:00.0: WRT: Failed to dump region: id=20, type=19
Mar 03 15:31:50 fedora kernel: iwlwifi 0000:0a:00.0: WRT: Failed to dump region: id=22, type=10
Mar 03 15:31:50 fedora kernel: iwlwifi 0000:0a:00.0: WRT: Failed to dump region: id=34, type=10
Mar 03 15:31:52 fedora kernel: iwlwifi 0000:0a:00.0: WRT: Invalid buffer destination
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: WFPM_UMAC_PD_NOTIFICATION: 0x5a5a5a5a
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: WFPM_LMAC2_PD_NOTIFICATION: 0x5a5a5a5a
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: WFPM_AUTH_KEY_0: 0x5a5a5a5a
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: CNVI_SCU_SEQ_DATA_DW9: 0x5a5a5a5a
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: SecBoot CPU1 Status: 0x5a5a5a5a, CPU2 Status: 0x5a5a5a5a
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: WFPM_LMAC1_PD_NOTIFICATION: 0x5a5a5a5a
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: HPM_SECONDARY_DEVICE_STATE: 0x5a5a5a5a
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: WFPM_MAC_OTP_CFG7_ADDR: 0x5a5a5a5a
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: WFPM_MAC_OTP_CFG7_DATA: 0x5a5a5a5a
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: UMAC CURRENT PC: 0xd05c18
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: LMAC1 CURRENT PC: 0xd05c1c
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: WRT: Collecting data: ini trigger 13 fired (delay=0ms).
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: HW error, resetting before reading
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: Loaded firmware version: 86.fb5c9aeb.0 ty-a0-gf-a0-86.ucode
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | ADVANCED_SYSASSERT          
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | trm_hw_status0
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | trm_hw_status1
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | branchlink2
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | interruptlink1
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | interruptlink2
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | data1
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | data2
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | data3
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | beacon time
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | tsf low
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | tsf hi
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | time gp1
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | time gp2
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | uCode revision type
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | uCode version major
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | uCode version minor
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | hw version
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | board version
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | hcmd
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | isr0
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | isr1
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | isr2
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | isr3
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | isr4
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | last cmd Id
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | wait_event
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | l2p_control
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | l2p_duration
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | l2p_mhvalid
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | l2p_addr_match
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | lmpm_pmg_sel
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | timestamp
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | flow_handler
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | ADVANCED_SYSASSERT
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | umac branchlink1
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | umac branchlink2
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | umac interruptlink1
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | umac interruptlink2
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | umac data1
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | umac data2
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | umac data3
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | umac major
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | umac minor
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | frame pointer
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | stack pointer
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | last host cmd
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x00000000 | isr status reg
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: IML/ROM dump:
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x5A5A | IML/ROM SYSASSERT
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x5A5A5A5A | IML/ROM error/state
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x5A5A5A5A | IML/ROM data1
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: 0x5A5A5A5A | IML/ROM WFPM_AUTH_KEY_0
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: Failed to start RT ucode: -110
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: Failed to start RT ucode: -110
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: WRT: Collecting data: ini trigger 13 fired (delay=0ms).
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: WRT: Failed to dump region: id=1, type=10
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: Failed to get monitor header
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: WRT: Failed to fill region header: id=16, type=2
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: WRT: Failed to dump region: id=20, type=19
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: WRT: Failed to dump region: id=22, type=10
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: WRT: Failed to dump region: id=1, type=10
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: Failed to get monitor header
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: WRT: Failed to fill region header: id=16, type=2
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: WRT: Failed to dump region: id=20, type=19
Mar 03 15:31:54 fedora kernel: iwlwifi 0000:0a:00.0: WRT: Failed to dump region: id=22, type=10
Mar 03 15:31:56 fedora kernel: iwlwifi 0000:0a:00.0: mac start retry 0
Mar 03 15:31:56 fedora kernel: ------------[ cut here ]------------
Mar 03 15:31:56 fedora kernel: Hardware became unavailable during restart.
Mar 03 15:31:56 fedora kernel: WARNING: CPU: 20 PID: 269 at net/mac80211/util.c:2595 ieee80211_reconfig+0xce/0x14e0 [mac80211]
Mar 03 15:31:56 fedora kernel: Modules linked in: uinput rfcomm snd_seq_dummy snd_hrtimer nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat nf_nat >
Mar 03 15:31:56 fedora kernel:  polyval_generic drm_suballoc_helper drm_display_helper ghash_clmulni_intel sha512_ssse3 cec sha256_ssse3 sha1_ssse3 ccp drm_ttm_helper sp5100_tco ttm video wmi ip6_tables ip_tables fuse i2c_dev
Mar 03 15:31:56 fedora kernel: CPU: 20 PID: 269 Comm: kworker/20:1 Tainted: G        W          6.7.6-200.fc39.x86_64 #1
Mar 03 15:31:56 fedora kernel: Hardware name: ASUS System Product Name/ROG STRIX X670E-E GAMING WIFI, BIOS 1905 02/05/2024
Mar 03 15:31:56 fedora kernel: Workqueue: events_freezable ieee80211_restart_work [mac80211]
Mar 03 15:31:56 fedora kernel: RIP: 0010:ieee80211_reconfig+0xce/0x14e0 [mac80211]
Mar 03 15:31:56 fedora kernel: Code: c0 0f 85 9d 01 00 00 c6 87 85 05 00 00 00 e8 39 8b fb ff 41 89 c4 85 c0 0f 84 d9 02 00 00 48 c7 c7 88 f7 c9 c1 e8 a2 e6 55 ea <0f> 0b 4c 89 f7 e8 b8 c1 ff ff e9 3b 01 00 00 c6 44 24 17 00 41 8b
Mar 03 15:31:56 fedora kernel: RSP: 0018:ffffa8d500b7fd68 EFLAGS: 00010282
Mar 03 15:31:56 fedora kernel: RAX: 0000000000000000 RBX: ffff95e40cbd9aa0 RCX: 0000000000000027
Mar 03 15:31:56 fedora kernel: RDX: ffff95f31e5215c8 RSI: 0000000000000001 RDI: ffff95f31e5215c0
Mar 03 15:31:56 fedora kernel: RBP: ffff95e40cbd9e88 R08: 0000000000000000 R09: ffffa8d500b7fbf0
Mar 03 15:31:56 fedora kernel: R10: 0000000000000003 R11: ffffffffae546828 R12: 00000000ffffff92
Mar 03 15:31:56 fedora kernel: R13: ffff95e40cbd8900 R14: ffff95e40cbd8900 R15: ffff95e40cbd9e90
Mar 03 15:31:56 fedora kernel: FS:  0000000000000000(0000) GS:ffff95f31e500000(0000) knlGS:0000000000000000
Mar 03 15:31:56 fedora kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Mar 03 15:31:56 fedora kernel: CR2: 00005605ef7f4048 CR3: 000000053f422000 CR4: 0000000000f50ef0
Mar 03 15:31:56 fedora kernel: PKRU: 55555554
Mar 03 15:31:56 fedora kernel: Call Trace:
Mar 03 15:31:56 fedora kernel:  <TASK>
Mar 03 15:31:56 fedora kernel:  ? ieee80211_reconfig+0xce/0x14e0 [mac80211]
Mar 03 15:31:56 fedora kernel:  ? __warn+0x81/0x130
Mar 03 15:31:56 fedora kernel:  ? ieee80211_reconfig+0xce/0x14e0 [mac80211]
Mar 03 15:31:56 fedora kernel:  ? report_bug+0x171/0x1a0
Mar 03 15:31:56 fedora kernel:  ? prb_read_valid+0x1b/0x30
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? handle_bug+0x3c/0x80
Mar 03 15:31:56 fedora kernel:  ? exc_invalid_op+0x17/0x70
Mar 03 15:31:56 fedora kernel:  ? asm_exc_invalid_op+0x1a/0x20
Mar 03 15:31:56 fedora kernel:  ? ieee80211_reconfig+0xce/0x14e0 [mac80211]
Mar 03 15:31:56 fedora kernel:  ? ieee80211_reconfig+0xce/0x14e0 [mac80211]
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? synchronize_rcu_expedited+0x356/0x430
Mar 03 15:31:56 fedora kernel:  ? __pfx_wait_rcu_exp_gp+0x10/0x10
Mar 03 15:31:56 fedora kernel:  ? __pfx_autoremove_wake_function+0x10/0x10
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? __timer_delete_sync+0x7d/0xe0
Mar 03 15:31:56 fedora kernel:  ieee80211_restart_work+0xe2/0x150 [mac80211]
Mar 03 15:31:56 fedora kernel:  process_one_work+0x171/0x340
Mar 03 15:31:56 fedora kernel:  worker_thread+0x27b/0x3a0
Mar 03 15:31:56 fedora kernel:  ? __pfx_worker_thread+0x10/0x10
Mar 03 15:31:56 fedora kernel:  kthread+0xe5/0x120
Mar 03 15:31:56 fedora kernel:  ? __pfx_kthread+0x10/0x10
Mar 03 15:31:56 fedora kernel:  ret_from_fork+0x31/0x50
Mar 03 15:31:56 fedora kernel:  ? __pfx_kthread+0x10/0x10
Mar 03 15:31:56 fedora kernel:  ret_from_fork_asm+0x1b/0x30
Mar 03 15:31:56 fedora kernel:  </TASK>
Mar 03 15:31:56 fedora kernel: ---[ end trace 0000000000000000 ]---
Mar 03 15:31:56 fedora kernel: iwlwifi 0000:0a:00.0: Failed to synchronize multicast groups update
Mar 03 15:31:56 fedora kernel: wlp10s0: deauthenticating from fc:34:97:70:a4:e4 by local choice (Reason: 3=DEAUTH_LEAVING)
Mar 03 15:31:56 fedora kernel: wlp10s0: HW problem - can not stop rx aggregation for fc:34:97:70:a4:e4 tid 0
Mar 03 15:31:56 fedora kernel: wlp10s0: HW problem - can not stop rx aggregation for fc:34:97:70:a4:e4 tid 2
Mar 03 15:31:56 fedora kernel: wlp10s0: HW problem - can not stop rx aggregation for fc:34:97:70:a4:e4 tid 3
Mar 03 15:31:56 fedora kernel: wlp10s0: HW problem - can not stop rx aggregation for fc:34:97:70:a4:e4 tid 4
Mar 03 15:31:56 fedora kernel: wlp10s0: HW problem - can not stop rx aggregation for fc:34:97:70:a4:e4 tid 6
Mar 03 15:31:56 fedora kernel: iwlwifi 0000:0a:00.0: Failed to trigger RX queues sync (-5)
Mar 03 15:31:56 fedora kernel: ------------[ cut here ]------------
Mar 03 15:31:56 fedora kernel: WARNING: CPU: 20 PID: 269 at net/mac80211/sta_info.c:1438 __sta_info_destroy_part2+0x173/0x180 [mac80211]
Mar 03 15:31:56 fedora kernel: Modules linked in: uinput rfcomm snd_seq_dummy snd_hrtimer nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat nf_nat >
Mar 03 15:31:56 fedora kernel:  polyval_generic drm_suballoc_helper drm_display_helper ghash_clmulni_intel sha512_ssse3 cec sha256_ssse3 sha1_ssse3 ccp drm_ttm_helper sp5100_tco ttm video wmi ip6_tables ip_tables fuse i2c_dev
Mar 03 15:31:56 fedora kernel: CPU: 20 PID: 269 Comm: kworker/20:1 Tainted: G        W          6.7.6-200.fc39.x86_64 #1
Mar 03 15:31:56 fedora kernel: Hardware name: ASUS System Product Name/ROG STRIX X670E-E GAMING WIFI, BIOS 1905 02/05/2024
Mar 03 15:31:56 fedora kernel: Workqueue: events_freezable ieee80211_restart_work [mac80211]
Mar 03 15:31:56 fedora kernel: RIP: 0010:__sta_info_destroy_part2+0x173/0x180 [mac80211]
Mar 03 15:31:56 fedora kernel: Code: ff ff 85 c0 0f 84 48 ff ff ff 0f 0b e9 41 ff ff ff 41 0f b6 d6 be 03 00 00 00 48 89 df e8 75 be ff ff 85 c0 0f 84 c8 fe ff ff <0f> 0b e9 c1 fe ff ff 66 0f 1f 44 00 00 90 90 90 90 90 90 90 90 90
Mar 03 15:31:56 fedora kernel: RSP: 0018:ffffa8d500b7f938 EFLAGS: 00010282
Mar 03 15:31:56 fedora kernel: RAX: 00000000fffffffb RBX: ffff95e408612000 RCX: 0000000000000004
Mar 03 15:31:56 fedora kernel: RDX: 0000000000000000 RSI: ffff95e4675889c0 RDI: ffff95e40cbd8900
Mar 03 15:31:56 fedora kernel: RBP: 0000000000000000 R08: 0000000000000003 R09: 0000000000000000
Mar 03 15:31:56 fedora kernel: R10: ffff95f31e5342d0 R11: 0000000000000000 R12: ffff95e40cbd8900
Mar 03 15:31:56 fedora kernel: R13: ffff95e4675889c0 R14: 0000000000000000 R15: ffff95e40cbd8f18
Mar 03 15:31:56 fedora kernel: FS:  0000000000000000(0000) GS:ffff95f31e500000(0000) knlGS:0000000000000000
Mar 03 15:31:56 fedora kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Mar 03 15:31:56 fedora kernel: CR2: 00005605ef7f4048 CR3: 000000053f422000 CR4: 0000000000f50ef0
Mar 03 15:31:56 fedora kernel: PKRU: 55555554
Mar 03 15:31:56 fedora kernel: Call Trace:
Mar 03 15:31:56 fedora kernel:  <TASK>
Mar 03 15:31:56 fedora kernel:  ? __sta_info_destroy_part2+0x173/0x180 [mac80211]
Mar 03 15:31:56 fedora kernel:  ? __warn+0x81/0x130
Mar 03 15:31:56 fedora kernel:  ? __sta_info_destroy_part2+0x173/0x180 [mac80211]
Mar 03 15:31:56 fedora kernel:  ? report_bug+0x171/0x1a0
Mar 03 15:31:56 fedora kernel:  ? handle_bug+0x3c/0x80
Mar 03 15:31:56 fedora kernel:  ? exc_invalid_op+0x17/0x70
Mar 03 15:31:56 fedora kernel:  ? asm_exc_invalid_op+0x1a/0x20
Mar 03 15:31:56 fedora kernel:  ? __sta_info_destroy_part2+0x173/0x180 [mac80211]
Mar 03 15:31:56 fedora kernel:  ? __sta_info_destroy_part2+0x16b/0x180 [mac80211]
Mar 03 15:31:56 fedora kernel:  __sta_info_flush+0x15d/0x1e0 [mac80211]
Mar 03 15:31:56 fedora kernel:  ieee80211_set_disassoc+0x13b/0x600 [mac80211]
Mar 03 15:31:56 fedora kernel:  ieee80211_mgd_deauth+0x13f/0x3f0 [mac80211]
Mar 03 15:31:56 fedora kernel:  cfg80211_mlme_deauth+0xb7/0x1d0 [cfg80211]
Mar 03 15:31:56 fedora kernel:  cfg80211_mlme_down+0x65/0x90 [cfg80211]
Mar 03 15:31:56 fedora kernel:  cfg80211_disconnect+0x177/0x1e0 [cfg80211]
Mar 03 15:31:56 fedora kernel:  cfg80211_netdev_notifier_call+0x121/0x4a0 [cfg80211]
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? _dev_err+0x79/0xa0
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? select_task_rq_fair+0x6d8/0x1ad0
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? inetdev_event+0x3d/0x6f0
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  notifier_call_chain+0x5a/0xd0
Mar 03 15:31:56 fedora kernel:  __dev_close_many+0x5f/0x110
Mar 03 15:31:56 fedora kernel:  dev_close_many+0x8f/0x150
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  dev_close+0x83/0xb0
Mar 03 15:31:56 fedora kernel:  cfg80211_shutdown_all_interfaces+0x4d/0xf0 [cfg80211]
Mar 03 15:31:56 fedora kernel:  ieee80211_restart_work+0x11c/0x150 [mac80211]
Mar 03 15:31:56 fedora kernel:  process_one_work+0x171/0x340
Mar 03 15:31:56 fedora kernel:  worker_thread+0x27b/0x3a0
Mar 03 15:31:56 fedora kernel:  ? __pfx_worker_thread+0x10/0x10
Mar 03 15:31:56 fedora kernel:  kthread+0xe5/0x120
Mar 03 15:31:56 fedora kernel:  ? __pfx_kthread+0x10/0x10
Mar 03 15:31:56 fedora kernel:  ret_from_fork+0x31/0x50
Mar 03 15:31:56 fedora kernel:  ? __pfx_kthread+0x10/0x10
Mar 03 15:31:56 fedora kernel:  ret_from_fork_asm+0x1b/0x30
Mar 03 15:31:56 fedora kernel:  </TASK>
Mar 03 15:31:56 fedora kernel: ---[ end trace 0000000000000000 ]---
Mar 03 15:31:56 fedora kernel: wlp10s0: failed to remove key (0, fc:34:97:70:a4:e4) from hardware (-5)
Mar 03 15:31:56 fedora kernel: ------------[ cut here ]------------
Mar 03 15:31:56 fedora kernel: WARNING: CPU: 20 PID: 269 at net/mac80211/sta_info.c:1455 __sta_info_destroy_part2+0x126/0x180 [mac80211]
Mar 03 15:31:56 fedora kernel: Modules linked in: uinput rfcomm snd_seq_dummy snd_hrtimer nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat nf_nat >
Mar 03 15:31:56 fedora kernel:  polyval_generic drm_suballoc_helper drm_display_helper ghash_clmulni_intel sha512_ssse3 cec sha256_ssse3 sha1_ssse3 ccp drm_ttm_helper sp5100_tco ttm video wmi ip6_tables ip_tables fuse i2c_dev
Mar 03 15:31:56 fedora kernel: CPU: 20 PID: 269 Comm: kworker/20:1 Tainted: G        W          6.7.6-200.fc39.x86_64 #1
Mar 03 15:31:56 fedora kernel: Hardware name: ASUS System Product Name/ROG STRIX X670E-E GAMING WIFI, BIOS 1905 02/05/2024
Mar 03 15:31:56 fedora kernel: Workqueue: events_freezable ieee80211_restart_work [mac80211]
Mar 03 15:31:56 fedora kernel: RIP: 0010:__sta_info_destroy_part2+0x126/0x180 [mac80211]
Mar 03 15:31:56 fedora kernel: Code: 50 73 02 00 48 8b 43 50 48 89 df 48 8b a8 58 07 00 00 e8 fd bb ff ff 48 89 de 5b 48 89 ef 5d 41 5c 41 5d 41 5e e9 da e9 ff ff <0f> 0b 80 bb d4 00 00 00 00 0f 84 66 ff ff ff 45 31 c0 b9 01 00 00
Mar 03 15:31:56 fedora kernel: RSP: 0018:ffffa8d500b7f938 EFLAGS: 00010282
Mar 03 15:31:56 fedora kernel: RAX: 00000000fffffffb RBX: ffff95e408612000 RCX: 0000000000000004
Mar 03 15:31:56 fedora kernel: RDX: 0000000000000000 RSI: ffff95e4675889c0 RDI: ffff95e40cbd8900
Mar 03 15:31:56 fedora kernel: RBP: 0000000000000000 R08: 0000000000000003 R09: 000000000020000c
Mar 03 15:31:56 fedora kernel: R10: ffff95e49b45a400 R11: ffff95e4675889c0 R12: ffff95e40cbd8900
Mar 03 15:31:56 fedora kernel: R13: ffff95e4675889c0 R14: 0000000000000000 R15: ffff95e40cbd8f18
Mar 03 15:31:56 fedora kernel: FS:  0000000000000000(0000) GS:ffff95f31e500000(0000) knlGS:0000000000000000
Mar 03 15:31:56 fedora kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Mar 03 15:31:56 fedora kernel: CR2: 00005605ef7f4048 CR3: 000000053f422000 CR4: 0000000000f50ef0
Mar 03 15:31:56 fedora kernel: PKRU: 55555554
Mar 03 15:31:56 fedora kernel: Call Trace:
Mar 03 15:31:56 fedora kernel:  <TASK>
Mar 03 15:31:56 fedora kernel:  ? __sta_info_destroy_part2+0x126/0x180 [mac80211]
Mar 03 15:31:56 fedora kernel:  ? __warn+0x81/0x130
Mar 03 15:31:56 fedora kernel:  ? __sta_info_destroy_part2+0x126/0x180 [mac80211]
Mar 03 15:31:56 fedora kernel:  ? report_bug+0x171/0x1a0
Mar 03 15:31:56 fedora kernel:  ? handle_bug+0x3c/0x80
Mar 03 15:31:56 fedora kernel:  ? exc_invalid_op+0x17/0x70
Mar 03 15:31:56 fedora kernel:  ? asm_exc_invalid_op+0x1a/0x20
Mar 03 15:31:56 fedora kernel:  ? __sta_info_destroy_part2+0x126/0x180 [mac80211]
Mar 03 15:31:56 fedora kernel:  ? __sta_info_destroy_part2+0x7b/0x180 [mac80211]
Mar 03 15:31:56 fedora kernel:  __sta_info_flush+0x15d/0x1e0 [mac80211]
Mar 03 15:31:56 fedora kernel:  ieee80211_set_disassoc+0x13b/0x600 [mac80211]
Mar 03 15:31:56 fedora kernel:  ieee80211_mgd_deauth+0x13f/0x3f0 [mac80211]
Mar 03 15:31:56 fedora kernel:  cfg80211_mlme_deauth+0xb7/0x1d0 [cfg80211]
Mar 03 15:31:56 fedora kernel:  cfg80211_mlme_down+0x65/0x90 [cfg80211]
Mar 03 15:31:56 fedora kernel:  cfg80211_disconnect+0x177/0x1e0 [cfg80211]
Mar 03 15:31:56 fedora kernel:  cfg80211_netdev_notifier_call+0x121/0x4a0 [cfg80211]
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? _dev_err+0x79/0xa0
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? select_task_rq_fair+0x6d8/0x1ad0
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? inetdev_event+0x3d/0x6f0
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  notifier_call_chain+0x5a/0xd0
Mar 03 15:31:56 fedora kernel:  __dev_close_many+0x5f/0x110
Mar 03 15:31:56 fedora kernel:  dev_close_many+0x8f/0x150
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  dev_close+0x83/0xb0
Mar 03 15:31:56 fedora kernel:  cfg80211_shutdown_all_interfaces+0x4d/0xf0 [cfg80211]
Mar 03 15:31:56 fedora kernel:  ieee80211_restart_work+0x11c/0x150 [mac80211]
Mar 03 15:31:56 fedora kernel:  process_one_work+0x171/0x340
Mar 03 15:31:56 fedora kernel:  worker_thread+0x27b/0x3a0
Mar 03 15:31:56 fedora kernel:  ? __pfx_worker_thread+0x10/0x10
Mar 03 15:31:56 fedora kernel:  kthread+0xe5/0x120
Mar 03 15:31:56 fedora kernel:  ? __pfx_kthread+0x10/0x10
Mar 03 15:31:56 fedora kernel:  ret_from_fork+0x31/0x50
Mar 03 15:31:56 fedora kernel:  ? __pfx_kthread+0x10/0x10
Mar 03 15:31:56 fedora kernel:  ret_from_fork_asm+0x1b/0x30
Mar 03 15:31:56 fedora kernel:  </TASK>
Mar 03 15:31:56 fedora kernel: ---[ end trace 0000000000000000 ]---
Mar 03 15:31:56 fedora kernel: ------------[ cut here ]------------
Mar 03 15:31:56 fedora kernel: WARNING: CPU: 20 PID: 269 at net/mac80211/sta_info.c:1463 __sta_info_destroy_part2+0x153/0x180 [mac80211]
Mar 03 15:31:56 fedora kernel: Modules linked in: uinput rfcomm snd_seq_dummy snd_hrtimer nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat nf_nat >
Mar 03 15:31:56 fedora kernel:  polyval_generic drm_suballoc_helper drm_display_helper ghash_clmulni_intel sha512_ssse3 cec sha256_ssse3 sha1_ssse3 ccp drm_ttm_helper sp5100_tco ttm video wmi ip6_tables ip_tables fuse i2c_dev
Mar 03 15:31:56 fedora kernel: CPU: 20 PID: 269 Comm: kworker/20:1 Tainted: G        W          6.7.6-200.fc39.x86_64 #1
Mar 03 15:31:56 fedora kernel: Hardware name: ASUS System Product Name/ROG STRIX X670E-E GAMING WIFI, BIOS 1905 02/05/2024
Mar 03 15:31:56 fedora kernel: Workqueue: events_freezable ieee80211_restart_work [mac80211]
Mar 03 15:31:56 fedora kernel: RIP: 0010:__sta_info_destroy_part2+0x153/0x180 [mac80211]
Mar 03 15:31:56 fedora kernel: Code: bb d4 00 00 00 00 0f 84 66 ff ff ff 45 31 c0 b9 01 00 00 00 48 89 da 4c 89 ee 4c 89 e7 e8 25 85 ff ff 85 c0 0f 84 48 ff ff ff <0f> 0b e9 41 ff ff ff 41 0f b6 d6 be 03 00 00 00 48 89 df e8 75 be
Mar 03 15:31:56 fedora kernel: RSP: 0018:ffffa8d500b7f938 EFLAGS: 00010282
Mar 03 15:31:56 fedora kernel: RAX: 00000000fffffffb RBX: ffff95e408612000 RCX: 0000000000000001
Mar 03 15:31:56 fedora kernel: RDX: 0000000000000000 RSI: ffff95e4675889c0 RDI: ffff95e40cbd8900
Mar 03 15:31:56 fedora kernel: RBP: 0000000000000000 R08: 0000000000000000 R09: 000000000020000c
Mar 03 15:31:56 fedora kernel: R10: ffff95e49b45a400 R11: ffff95e4675889c0 R12: ffff95e40cbd8900
Mar 03 15:31:56 fedora kernel: R13: ffff95e4675889c0 R14: 0000000000000000 R15: ffff95e40cbd8f18
Mar 03 15:31:56 fedora kernel: FS:  0000000000000000(0000) GS:ffff95f31e500000(0000) knlGS:0000000000000000
Mar 03 15:31:56 fedora kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Mar 03 15:31:56 fedora kernel: CR2: 00005605ef7f4048 CR3: 000000053f422000 CR4: 0000000000f50ef0
Mar 03 15:31:56 fedora kernel: PKRU: 55555554
Mar 03 15:31:56 fedora kernel: Call Trace:
Mar 03 15:31:56 fedora kernel:  <TASK>
Mar 03 15:31:56 fedora kernel:  ? __sta_info_destroy_part2+0x153/0x180 [mac80211]
Mar 03 15:31:56 fedora kernel:  ? __warn+0x81/0x130
Mar 03 15:31:56 fedora kernel:  ? __sta_info_destroy_part2+0x153/0x180 [mac80211]
Mar 03 15:31:56 fedora kernel:  ? report_bug+0x171/0x1a0
Mar 03 15:31:56 fedora kernel:  ? handle_bug+0x3c/0x80
Mar 03 15:31:56 fedora kernel:  ? exc_invalid_op+0x17/0x70
Mar 03 15:31:56 fedora kernel:  ? asm_exc_invalid_op+0x1a/0x20
Mar 03 15:31:56 fedora kernel:  ? __sta_info_destroy_part2+0x153/0x180 [mac80211]
Mar 03 15:31:56 fedora kernel:  ? __sta_info_destroy_part2+0x14b/0x180 [mac80211]
Mar 03 15:31:56 fedora kernel:  __sta_info_flush+0x15d/0x1e0 [mac80211]
Mar 03 15:31:56 fedora kernel:  ieee80211_set_disassoc+0x13b/0x600 [mac80211]
Mar 03 15:31:56 fedora kernel:  ieee80211_mgd_deauth+0x13f/0x3f0 [mac80211]
Mar 03 15:31:56 fedora kernel:  cfg80211_mlme_deauth+0xb7/0x1d0 [cfg80211]
Mar 03 15:31:56 fedora kernel:  cfg80211_mlme_down+0x65/0x90 [cfg80211]
Mar 03 15:31:56 fedora kernel:  cfg80211_disconnect+0x177/0x1e0 [cfg80211]
Mar 03 15:31:56 fedora kernel:  cfg80211_netdev_notifier_call+0x121/0x4a0 [cfg80211]
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? _dev_err+0x79/0xa0
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? select_task_rq_fair+0x6d8/0x1ad0
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? inetdev_event+0x3d/0x6f0
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  notifier_call_chain+0x5a/0xd0
Mar 03 15:31:56 fedora kernel:  __dev_close_many+0x5f/0x110
Mar 03 15:31:56 fedora kernel:  dev_close_many+0x8f/0x150
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  dev_close+0x83/0xb0
Mar 03 15:31:56 fedora kernel:  cfg80211_shutdown_all_interfaces+0x4d/0xf0 [cfg80211]
Mar 03 15:31:56 fedora kernel:  ieee80211_restart_work+0x11c/0x150 [mac80211]
Mar 03 15:31:56 fedora kernel:  process_one_work+0x171/0x340
Mar 03 15:31:56 fedora kernel:  worker_thread+0x27b/0x3a0
Mar 03 15:31:56 fedora kernel:  ? __pfx_worker_thread+0x10/0x10
Mar 03 15:31:56 fedora kernel:  kthread+0xe5/0x120
Mar 03 15:31:56 fedora kernel:  ? __pfx_kthread+0x10/0x10
Mar 03 15:31:56 fedora kernel:  ret_from_fork+0x31/0x50
Mar 03 15:31:56 fedora kernel:  ? __pfx_kthread+0x10/0x10
Mar 03 15:31:56 fedora kernel:  ret_from_fork_asm+0x1b/0x30
Mar 03 15:31:56 fedora kernel:  </TASK>
Mar 03 15:31:56 fedora kernel: ---[ end trace 0000000000000000 ]---
Mar 03 15:31:56 fedora kernel: ------------[ cut here ]------------
Mar 03 15:31:56 fedora kernel: WARNING: CPU: 20 PID: 269 at net/mac80211/sta_info.c:427 sta_info_free+0xb1/0x110 [mac80211]
Mar 03 15:31:56 fedora kernel: Modules linked in: uinput rfcomm snd_seq_dummy snd_hrtimer nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat nf_nat >
Mar 03 15:31:56 fedora kernel:  polyval_generic drm_suballoc_helper drm_display_helper ghash_clmulni_intel sha512_ssse3 cec sha256_ssse3 sha1_ssse3 ccp drm_ttm_helper sp5100_tco ttm video wmi ip6_tables ip_tables fuse i2c_dev
Mar 03 15:31:56 fedora kernel: CPU: 20 PID: 269 Comm: kworker/20:1 Tainted: G        W          6.7.6-200.fc39.x86_64 #1
Mar 03 15:31:56 fedora kernel: Hardware name: ASUS System Product Name/ROG STRIX X670E-E GAMING WIFI, BIOS 1905 02/05/2024
Mar 03 15:31:56 fedora kernel: Workqueue: events_freezable ieee80211_restart_work [mac80211]
Mar 03 15:31:56 fedora kernel: RIP: 0010:sta_info_free+0xb1/0x110 [mac80211]
Mar 03 15:31:56 fedora kernel: Code: 0a 00 00 e8 c1 84 82 ea 48 8b bd a8 00 00 00 e8 b5 84 82 ea 48 8b bd d8 06 00 00 e8 39 3a 82 ea 48 89 ef 5b 5d e9 9f 84 82 ea <0f> 0b 83 ee 01 ba 01 00 00 00 48 89 ef e8 1d d4 ff ff 85 c0 75 1f
Mar 03 15:31:56 fedora kernel: RSP: 0018:ffffa8d500b7f950 EFLAGS: 00010206
Mar 03 15:31:56 fedora kernel: RAX: 000000000410010b RBX: 000000000000000f RCX: 0000000000000000
Mar 03 15:31:56 fedora kernel: RDX: ffff95e408612678 RSI: 0000000000000004 RDI: ffff95e408612000
Mar 03 15:31:56 fedora kernel: RBP: ffff95e408612000 R08: 00000000000003f2 R09: 0000000000000000
Mar 03 15:31:56 fedora kernel: R10: 00000000a9a15ab4 R11: 0000000000000000 R12: ffff95e4675889c0
Mar 03 15:31:56 fedora kernel: R13: ffffa8d500b7f980 R14: 0000000000000000 R15: ffff95e40cbd8f18
Mar 03 15:31:56 fedora kernel: FS:  0000000000000000(0000) GS:ffff95f31e500000(0000) knlGS:0000000000000000
Mar 03 15:31:56 fedora kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Mar 03 15:31:56 fedora kernel: CR2: 00005605ef7f4048 CR3: 000000053f422000 CR4: 0000000000f50ef0
Mar 03 15:31:56 fedora kernel: PKRU: 55555554
Mar 03 15:31:56 fedora kernel: Call Trace:
Mar 03 15:31:56 fedora kernel:  <TASK>
Mar 03 15:31:56 fedora kernel:  ? sta_info_free+0xb1/0x110 [mac80211]
Mar 03 15:31:56 fedora kernel:  ? __warn+0x81/0x130
Mar 03 15:31:56 fedora kernel:  ? sta_info_free+0xb1/0x110 [mac80211]
Mar 03 15:31:56 fedora kernel:  ? report_bug+0x171/0x1a0
Mar 03 15:31:56 fedora kernel:  ? handle_bug+0x3c/0x80
Mar 03 15:31:56 fedora kernel:  ? exc_invalid_op+0x17/0x70
Mar 03 15:31:56 fedora kernel:  ? asm_exc_invalid_op+0x1a/0x20
Mar 03 15:31:56 fedora kernel:  ? sta_info_free+0xb1/0x110 [mac80211]
Mar 03 15:31:56 fedora kernel:  __sta_info_flush+0x15d/0x1e0 [mac80211]
Mar 03 15:31:56 fedora kernel:  ieee80211_set_disassoc+0x13b/0x600 [mac80211]
Mar 03 15:31:56 fedora kernel:  ieee80211_mgd_deauth+0x13f/0x3f0 [mac80211]
Mar 03 15:31:56 fedora kernel:  cfg80211_mlme_deauth+0xb7/0x1d0 [cfg80211]
Mar 03 15:31:56 fedora kernel:  cfg80211_mlme_down+0x65/0x90 [cfg80211]
Mar 03 15:31:56 fedora kernel:  cfg80211_disconnect+0x177/0x1e0 [cfg80211]
Mar 03 15:31:56 fedora kernel:  cfg80211_netdev_notifier_call+0x121/0x4a0 [cfg80211]
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? _dev_err+0x79/0xa0
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? select_task_rq_fair+0x6d8/0x1ad0
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? inetdev_event+0x3d/0x6f0
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  notifier_call_chain+0x5a/0xd0
Mar 03 15:31:56 fedora kernel:  __dev_close_many+0x5f/0x110
Mar 03 15:31:56 fedora kernel:  dev_close_many+0x8f/0x150
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  dev_close+0x83/0xb0
Mar 03 15:31:56 fedora kernel:  cfg80211_shutdown_all_interfaces+0x4d/0xf0 [cfg80211]
Mar 03 15:31:56 fedora kernel:  ieee80211_restart_work+0x11c/0x150 [mac80211]
Mar 03 15:31:56 fedora kernel:  process_one_work+0x171/0x340
Mar 03 15:31:56 fedora kernel:  worker_thread+0x27b/0x3a0
Mar 03 15:31:56 fedora kernel:  ? __pfx_worker_thread+0x10/0x10
Mar 03 15:31:56 fedora kernel:  kthread+0xe5/0x120
Mar 03 15:31:56 fedora kernel:  ? __pfx_kthread+0x10/0x10
Mar 03 15:31:56 fedora kernel:  ret_from_fork+0x31/0x50
Mar 03 15:31:56 fedora kernel:  ? __pfx_kthread+0x10/0x10
Mar 03 15:31:56 fedora kernel:  ret_from_fork_asm+0x1b/0x30
Mar 03 15:31:56 fedora kernel:  </TASK>
Mar 03 15:31:56 fedora kernel: ---[ end trace 0000000000000000 ]---
Mar 03 15:31:56 fedora kernel: ------------[ cut here ]------------
Mar 03 15:31:56 fedora kernel: sta_info_move_state() returned -5
Mar 03 15:31:56 fedora kernel: WARNING: CPU: 20 PID: 269 at net/mac80211/sta_info.c:430 sta_info_free+0x108/0x110 [mac80211]
Mar 03 15:31:56 fedora kernel: Modules linked in: uinput rfcomm snd_seq_dummy snd_hrtimer nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat nf_nat >
Mar 03 15:31:56 fedora kernel:  polyval_generic drm_suballoc_helper drm_display_helper ghash_clmulni_intel sha512_ssse3 cec sha256_ssse3 sha1_ssse3 ccp drm_ttm_helper sp5100_tco ttm video wmi ip6_tables ip_tables fuse i2c_dev
Mar 03 15:31:56 fedora kernel: CPU: 20 PID: 269 Comm: kworker/20:1 Tainted: G        W          6.7.6-200.fc39.x86_64 #1
Mar 03 15:31:56 fedora kernel: Hardware name: ASUS System Product Name/ROG STRIX X670E-E GAMING WIFI, BIOS 1905 02/05/2024
Mar 03 15:31:56 fedora kernel: Workqueue: events_freezable ieee80211_restart_work [mac80211]
Mar 03 15:31:56 fedora kernel: RIP: 0010:sta_info_free+0x108/0x110 [mac80211]
Mar 03 15:31:56 fedora kernel: Code: 00 00 10 00 74 cf eb cb 80 3d b0 47 0b 00 00 0f 85 53 ff ff ff 89 c6 48 c7 c7 88 e1 c9 c1 c6 05 9a 47 0b 00 01 e8 88 ee 59 ea <0f> 0b e9 37 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90
Mar 03 15:31:56 fedora kernel: RSP: 0018:ffffa8d500b7f950 EFLAGS: 00010286
Mar 03 15:31:56 fedora kernel: RAX: 0000000000000000 RBX: 000000000000000f RCX: 0000000000000027
Mar 03 15:31:56 fedora kernel: RDX: ffff95f31e5215c8 RSI: 0000000000000001 RDI: ffff95f31e5215c0
Mar 03 15:31:56 fedora kernel: RBP: ffff95e408612000 R08: 0000000000000000 R09: ffffa8d500b7f7d8
Mar 03 15:31:56 fedora kernel: R10: 0000000000000003 R11: ffffffffae546828 R12: ffff95e4675889c0
Mar 03 15:31:56 fedora kernel: R13: ffffa8d500b7f980 R14: 0000000000000000 R15: ffff95e40cbd8f18
Mar 03 15:31:56 fedora kernel: FS:  0000000000000000(0000) GS:ffff95f31e500000(0000) knlGS:0000000000000000
Mar 03 15:31:56 fedora kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Mar 03 15:31:56 fedora kernel: CR2: 00005605ef7f4048 CR3: 000000053f422000 CR4: 0000000000f50ef0
Mar 03 15:31:56 fedora kernel: PKRU: 55555554
Mar 03 15:31:56 fedora kernel: Call Trace:
Mar 03 15:31:56 fedora kernel:  <TASK>
Mar 03 15:31:56 fedora kernel:  ? sta_info_free+0x108/0x110 [mac80211]
Mar 03 15:31:56 fedora kernel:  ? __warn+0x81/0x130
Mar 03 15:31:56 fedora kernel:  ? sta_info_free+0x108/0x110 [mac80211]
Mar 03 15:31:56 fedora kernel:  ? report_bug+0x171/0x1a0
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? console_unlock+0x78/0x120
Mar 03 15:31:56 fedora kernel:  ? handle_bug+0x3c/0x80
Mar 03 15:31:56 fedora kernel:  ? exc_invalid_op+0x17/0x70
Mar 03 15:31:56 fedora kernel:  ? asm_exc_invalid_op+0x1a/0x20
Mar 03 15:31:56 fedora kernel:  ? sta_info_free+0x108/0x110 [mac80211]
Mar 03 15:31:56 fedora kernel:  __sta_info_flush+0x15d/0x1e0 [mac80211]
Mar 03 15:31:56 fedora kernel:  ieee80211_set_disassoc+0x13b/0x600 [mac80211]
Mar 03 15:31:56 fedora kernel:  ieee80211_mgd_deauth+0x13f/0x3f0 [mac80211]
Mar 03 15:31:56 fedora kernel:  cfg80211_mlme_deauth+0xb7/0x1d0 [cfg80211]
Mar 03 15:31:56 fedora kernel:  cfg80211_mlme_down+0x65/0x90 [cfg80211]
Mar 03 15:31:56 fedora kernel:  cfg80211_disconnect+0x177/0x1e0 [cfg80211]
Mar 03 15:31:56 fedora kernel:  cfg80211_netdev_notifier_call+0x121/0x4a0 [cfg80211]
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? _dev_err+0x79/0xa0
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? select_task_rq_fair+0x6d8/0x1ad0
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? inetdev_event+0x3d/0x6f0
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  notifier_call_chain+0x5a/0xd0
Mar 03 15:31:56 fedora kernel:  __dev_close_many+0x5f/0x110
Mar 03 15:31:56 fedora kernel:  dev_close_many+0x8f/0x150
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  dev_close+0x83/0xb0
Mar 03 15:31:56 fedora kernel:  cfg80211_shutdown_all_interfaces+0x4d/0xf0 [cfg80211]
Mar 03 15:31:56 fedora kernel:  ieee80211_restart_work+0x11c/0x150 [mac80211]
Mar 03 15:31:56 fedora kernel:  process_one_work+0x171/0x340
Mar 03 15:31:56 fedora kernel:  worker_thread+0x27b/0x3a0
Mar 03 15:31:56 fedora kernel:  ? __pfx_worker_thread+0x10/0x10
Mar 03 15:31:56 fedora kernel:  kthread+0xe5/0x120
Mar 03 15:31:56 fedora kernel:  ? __pfx_kthread+0x10/0x10
Mar 03 15:31:56 fedora kernel:  ret_from_fork+0x31/0x50
Mar 03 15:31:56 fedora kernel:  ? __pfx_kthread+0x10/0x10
Mar 03 15:31:56 fedora kernel:  ret_from_fork_asm+0x1b/0x30
Mar 03 15:31:56 fedora kernel:  </TASK>
Mar 03 15:31:56 fedora kernel: ---[ end trace 0000000000000000 ]---
Mar 03 15:31:56 fedora kernel: ------------[ cut here ]------------
Mar 03 15:31:56 fedora kernel: WARNING: CPU: 20 PID: 269 at net/mac80211/driver-ops.h:1007 ieee80211_del_chanctx+0x16d/0x180 [mac80211]
Mar 03 15:31:56 fedora kernel: Modules linked in: uinput rfcomm snd_seq_dummy snd_hrtimer nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat nf_nat >
Mar 03 15:31:56 fedora kernel:  polyval_generic drm_suballoc_helper drm_display_helper ghash_clmulni_intel sha512_ssse3 cec sha256_ssse3 sha1_ssse3 ccp drm_ttm_helper sp5100_tco ttm video wmi ip6_tables ip_tables fuse i2c_dev
Mar 03 15:31:56 fedora kernel: CPU: 20 PID: 269 Comm: kworker/20:1 Tainted: G        W          6.7.6-200.fc39.x86_64 #1
Mar 03 15:31:56 fedora kernel: Hardware name: ASUS System Product Name/ROG STRIX X670E-E GAMING WIFI, BIOS 1905 02/05/2024
Mar 03 15:31:56 fedora kernel: Workqueue: events_freezable ieee80211_restart_work [mac80211]
Mar 03 15:31:56 fedora kernel: RIP: 0010:ieee80211_del_chanctx+0x16d/0x180 [mac80211]
Mar 03 15:31:56 fedora kernel: Code: 9e 47 3e 0f 85 49 ff ff ff 0f 1f 44 00 00 e9 3f ff ff ff e8 45 4f 96 ff 48 8b bb f8 12 00 00 89 83 00 13 00 00 e9 c0 fe ff ff <0f> 0b e9 03 ff ff ff 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90
Mar 03 15:31:56 fedora kernel: RSP: 0018:ffffa8d500b7f978 EFLAGS: 00010246
Mar 03 15:31:56 fedora kernel: RAX: 0000000000000000 RBX: ffff95e40cbd8900 RCX: ffff95e40cbd9c20
Mar 03 15:31:56 fedora kernel: RDX: 0000000080000000 RSI: ffff95e551047c80 RDI: ffff95e40cbd8900
Mar 03 15:31:56 fedora kernel: RBP: ffff95e551047c80 R08: ffff95e551047cb0 R09: 0000000000000001
Mar 03 15:31:56 fedora kernel: R10: ffff95e408614000 R11: 0000000000000000 R12: ffff95e467589898
Mar 03 15:31:56 fedora kernel: R13: ffff95e551047cd8 R14: 0000000000000000 R15: ffffa8d500b7f9dc
Mar 03 15:31:56 fedora kernel: FS:  0000000000000000(0000) GS:ffff95f31e500000(0000) knlGS:0000000000000000
Mar 03 15:31:56 fedora kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Mar 03 15:31:56 fedora kernel: CR2: 00005605ef7f4048 CR3: 000000053f422000 CR4: 0000000000f50ef0
Mar 03 15:31:56 fedora kernel: PKRU: 55555554
Mar 03 15:31:56 fedora kernel: Call Trace:
Mar 03 15:31:56 fedora kernel:  <TASK>
Mar 03 15:31:56 fedora kernel:  ? ieee80211_del_chanctx+0x16d/0x180 [mac80211]
Mar 03 15:31:56 fedora kernel:  ? __warn+0x81/0x130
Mar 03 15:31:56 fedora kernel:  ? ieee80211_del_chanctx+0x16d/0x180 [mac80211]
Mar 03 15:31:56 fedora kernel:  ? report_bug+0x171/0x1a0
Mar 03 15:31:56 fedora kernel:  ? handle_bug+0x3c/0x80
Mar 03 15:31:56 fedora kernel:  ? exc_invalid_op+0x17/0x70
Mar 03 15:31:56 fedora kernel:  ? asm_exc_invalid_op+0x1a/0x20
Mar 03 15:31:56 fedora kernel:  ? ieee80211_del_chanctx+0x16d/0x180 [mac80211]
Mar 03 15:31:56 fedora kernel:  ? ieee80211_del_chanctx+0x89/0x180 [mac80211]
Mar 03 15:31:56 fedora kernel:  ieee80211_free_chanctx+0x91/0xc0 [mac80211]
Mar 03 15:31:56 fedora kernel:  __ieee80211_link_release_channel+0xea/0x120 [mac80211]
Mar 03 15:31:56 fedora kernel:  ieee80211_set_disassoc+0x340/0x600 [mac80211]
Mar 03 15:31:56 fedora kernel:  ieee80211_mgd_deauth+0x13f/0x3f0 [mac80211]
Mar 03 15:31:56 fedora kernel:  cfg80211_mlme_deauth+0xb7/0x1d0 [cfg80211]
Mar 03 15:31:56 fedora kernel:  cfg80211_mlme_down+0x65/0x90 [cfg80211]
Mar 03 15:31:56 fedora kernel:  cfg80211_disconnect+0x177/0x1e0 [cfg80211]
Mar 03 15:31:56 fedora kernel:  cfg80211_netdev_notifier_call+0x121/0x4a0 [cfg80211]
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? _dev_err+0x79/0xa0
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? select_task_rq_fair+0x6d8/0x1ad0
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? inetdev_event+0x3d/0x6f0
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  notifier_call_chain+0x5a/0xd0
Mar 03 15:31:56 fedora kernel:  __dev_close_many+0x5f/0x110
Mar 03 15:31:56 fedora kernel:  dev_close_many+0x8f/0x150
Mar 03 15:31:56 fedora kernel:  ? srso_alias_return_thunk+0x5/0xfbef5
Mar 03 15:31:56 fedora kernel:  dev_close+0x83/0xb0
Mar 03 15:31:56 fedora kernel:  cfg80211_shutdown_all_interfaces+0x4d/0xf0 [cfg80211]
Mar 03 15:31:56 fedora kernel:  ieee80211_restart_work+0x11c/0x150 [mac80211]
Mar 03 15:31:56 fedora kernel:  process_one_work+0x171/0x340
Mar 03 15:31:56 fedora kernel:  worker_thread+0x27b/0x3a0
Mar 03 15:31:56 fedora kernel:  ? __pfx_worker_thread+0x10/0x10
Mar 03 15:31:56 fedora kernel:  kthread+0xe5/0x120
Mar 03 15:31:56 fedora kernel:  ? __pfx_kthread+0x10/0x10
Mar 03 15:31:56 fedora kernel:  ret_from_fork+0x31/0x50
Mar 03 15:31:56 fedora kernel:  ? __pfx_kthread+0x10/0x10
Mar 03 15:31:56 fedora kernel:  ret_from_fork_asm+0x1b/0x30
Mar 03 15:31:56 fedora kernel:  </TASK>
Mar 03 15:31:56 fedora kernel: ---[ end trace 0000000000000000 ]---
Mar 03 15:31:56 fedora kernel: ------------[ cut here ]------------
```
Comment 46 Lev Lybin 2024-03-06 13:55:13 UTC
Hello, the same problem.
Kernel: 6.7.8
Archlinux, ASUS TUF, the latest version of BIOS.
dmesg: https://0x0.st/H7xy.txt
Comment 47 chris 2024-03-11 01:22:14 UTC
Hi Adam,

I've just caught up with the threads and your messages – my apologies for the delay in response. I'm genuinely impressed by the diplomatic and thorough approach you've taken on the community.intel.com forum. Your persistence and clarity in communication are commendable.

It's a good thing that you opened an ASUS case, it gives a a third open channel together with here and the channel with community.intel.com that you managed to keep open.

It is very possible that the heart of the problem revolves around BIOS ASPM too aggressive or buggy.

The systemd service you devised seems great. NixOS is using systemd too. It is a very convenient workaround until there is a better long-term solution.

I will upgrade to the new BIOS anytime soon: it's interesting to see that the upgrade to the latest bios has changed the error to a better outcome.

Best,
Chris
Comment 48 Adam 2024-03-15 19:21:46 UTC
Hello Chris,

Thank you for the compliments! 

I had some PSU issues and wasn't able to follow up on my case with ASUS until now. Upon contacting them today, there was unfortunately an "issue in the escalation process" so the issue was re-escalated today with priority. I'm told that ASUS will be in contact with me within 24-48 business hours.

For reference, the escalated case number is "N2403002688-0003"

I will surely update you here when I hear back! Glad you found the systemd service helpful.

Thanks
Adam
Comment 49 chris 2024-12-21 17:05:57 UTC
I'll take advantage of the fact that there's a newcomer to the discussion to return to the workaround proposed almost a year ago.

The workaround hack that Isaac and Adam came up with worked like a charm and I completely forgot about it.

Here is my NixOS version of it (snipped from the `configuration.nix` file):

```nix
  # Systemd Service to Disable ASPM for AX210
  systemd.services.disable-aspm = {
    description = "Disable ASPM on AX210 at boot";
    wantedBy = [ "multi-user.target" ];
    serviceConfig = {
      Type = "oneshot";
      # ExecStart = "${pkgs.bash}/bin/bash -c '${pkgs.pciutils}/bin/setpci -s 08:00.0 0x50.B=0x40'";
      ExecStart = "${pkgs.bash}/bin/bash -c '${pkgs.pciutils}/bin/setpci -s \"$(${pkgs.pciutils}/bin/lspci | ${pkgs.gawk}/bin/awk \\'/AX210/{print \\$1}\\')\" 0x50.B=0x40'";
      ExecStop = "${pkgs.bash}/bin/bash -c '${pkgs.pciutils}/bin/setpci -s \"$(${pkgs.pciutils}/bin/lspci | ${pkgs.gawk}/bin/awk \\'/AX210/{print \\$1}\\')\" 0x50.B=0x42'";
      RemainAfterExit = "yes";
    };
  };
```

Obviously this is just a hack and a workaround, and by no means an "accepted" solution, but it has worked so far.

Thanks,
Chris