Bug 217603 - S0ix: low S0ix residency on Dell G5 5590
Summary: S0ix: low S0ix residency on Dell G5 5590
Status: NEW
Alias: None
Product: Power Management
Classification: Unclassified
Component: Hibernation/Suspend (show other bugs)
Hardware: All Linux
: P3 normal
Assignee: Rafael J. Wysocki
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2023-06-28 01:31 UTC by Mateus Rodrigues Costa
Modified: 2023-06-28 19:34 UTC (History)
0 users

See Also:
Kernel Version:
Subsystem:
Regression: No
Bisected commit-id:


Attachments

Description Mateus Rodrigues Costa 2023-06-28 01:31:15 UTC
Details about laptop:
$ hostnamectl
     Static hostname: centauro
           Icon name: computer-laptop
             Chassis: laptop 💻
          Machine ID: <snip>
             Boot ID: <snip>
    Operating System: Fedora Linux 38.20230624.0 (Silverblue)
         CPE OS Name: cpe:/o:fedoraproject:fedora:38
      OS Support End: Tue 2024-05-14
OS Support Remaining: 10month 2w 2d
              Kernel: Linux 6.3.8-200.fc38.x86_64
        Architecture: x86-64
     Hardware Vendor: Dell Inc.
      Hardware Model: G5 5590
    Firmware Version: 1.24.0
       Firmware Date: Sun 2023-03-19

BIOS firmware is updated to latest version available as of now.
The system supports both S0ix and S3 sleep. It usually runs on S3 sleep forced with `mem_sleep_default=deep` but now I have moved back to S0ix by removing that option.
The system has a Nvidia Geforce GTX1660 Ti. The RPMFusion driver ships with a `/usr/lib/modprobe.d/nvidia-power-management.conf` which sets `NVreg_PreserveVideoMemoryAllocations=1` and `NVreg_TemporaryFilePath=/var/tmp`, I created a `/etc/modprobe.d/nvidia-power-management.conf` with `NVreg_EnableS0ixPowerManagement=1` to set S0ix for the Nvidia driver while overriding the equivalent file in /usr/lib/ (which likely conflicts anyway).
The NVMe and wireless card have been replaced recently: The SSD from an ADATA (likely OEM) to a WD Balck SN770, the wireless card from an Atheros QCA6174 (which had a tendency to die randomly, required a hack to restart without rebooting the system) to an Intel AX210.

I have run the S0ixSelftestTool tool twice and got the following results:

---

20230627-20-13-s0ix-output.log


---Check S2idle path S0ix Residency---:

The system OS Kernel version is:
Linux centauro 6.3.8-200.fc38.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Jun 15 02:15:40 UTC 2023 x86_64 GNU/Linux

---Check whether your system supports S0ix or not---:

Low Power S0 Idle is:1
Your system supports low power S0 idle capability.



---Check whether intel_pmc_core sysfs files exit---:

The pmc_core debug sysfs files are OK on your system.



---Judge PC10, S0ix residency available status---:
Test system does not support S0ix.y substate

Turbostat output: 
18.758553 sec
CPU%c1	CPU%c6	CPU%c7	GFX%rc6	Pkg%pc2	Pkg%pc3	Pkg%pc6	Pkg%pc7	Pkg%pc8	Pkg%pc9	Pk%pc10	SYS%LPI
1.57	1.16	96.10	4243.02	3.63	77.40	0.27	3.85	0.04	0.00	6.30	0.00
2.21	2.45	94.35	4245.70	3.63	77.43	0.27	3.85	0.04	0.00	6.30	0.00
2.25
0.79	0.81	96.61
2.03
0.79	0.80	96.65
1.91
1.14	1.25	95.76
2.20
0.82	0.62	95.76
2.96
0.91	1.02	97.48
0.82

CPU Core C7 residency after S2idle is: 96.10
GFX RC6 residency after S2idle is: 4243.02
CPU Package C-state 2 residency after S2idle is: 3.63
CPU Package C-state 3 residency after S2idle is: 77.40
CPU Package C-state 8 residency after S2idle is: 0.04
CPU Package C-state 9 residency after S2idle is: 0.00
CPU Package C-state 10 residency after S2idle is: 6.30
S0ix residency after S2idle is: 0.00

Need to debug which IP blocked S0ix since PC10 is observed.

---Debug S0ix failure scenario--PCH IP power gating check---:

Your system south port controller did not meet S0ix requirement: [31mSPC[0m

---Debug S0ix failure scenario--Setting No ACPI DSM Callback---:

Setting no ACPI DSM callback is not helpful to the S0ix residency.

---Debug PCIeport D states and link PM states---

0000:00:01.0 Link is in Detect

The link power management state of PCIe bridge: 0000:00:01.0 is OK.

The PCIe bridge link power management state is:
[31m0000:00:1b.0 Link is in L0[0m

The link power management state of PCIe bridge: [31m0000:00:1b.0[0m is not expected. 
which is expected to be L1.1 or L1.2, or user would run this script again.


The L1SubCap of the failed 0000:00:1b.0 is:


The L1SubCtl1 of the failed 0000:00:1b.0 is:



Checking PCI Devices tree diagram:
-[0000:00]-+-00.0  Intel Corporation 8th Gen Core Processor Host Bridge/DRAM Registers
           +-01.0-[01]--+-00.0  NVIDIA Corporation TU116M [GeForce GTX 1660 Ti Mobile]
           |            +-00.1  NVIDIA Corporation TU116 High Definition Audio Controller
           |            +-00.2  NVIDIA Corporation TU116 USB 3.1 Host Controller
           |            \-00.3  NVIDIA Corporation TU116 USB Type-C UCSI Controller
           +-02.0  Intel Corporation CoffeeLake-H GT2 [UHD Graphics 630]
           +-04.0  Intel Corporation Xeon E3-1200 v5/E3-1500 v5/6th Gen Core Processor Thermal Subsystem
           +-08.0  Intel Corporation Xeon E3-1200 v5/v6 / E3-1500 v5 / 6th/7th/8th Gen Core Processor Gaussian Mixture Model
           +-12.0  Intel Corporation Cannon Lake PCH Thermal Controller
           +-14.0  Intel Corporation Cannon Lake PCH USB 3.1 xHCI Host Controller
           +-14.2  Intel Corporation Cannon Lake PCH Shared SRAM
           +-15.0  Intel Corporation Cannon Lake PCH Serial IO I2C Controller #0
           +-15.1  Intel Corporation Cannon Lake PCH Serial IO I2C Controller #1
           +-16.0  Intel Corporation Cannon Lake PCH HECI Controller
           +-17.0  Intel Corporation Cannon Lake Mobile PCH SATA AHCI Controller
           +-1b.0-[02-3a]----00.0-[03-3a]--+-00.0-[04]----00.0  Intel Corporation JHL6340 Thunderbolt 3 NHI (C step) [Alpine Ridge 2C 2016]
           |                               +-01.0-[05-39]--
           |                               \-02.0-[3a]----00.0  Intel Corporation JHL6340 Thunderbolt 3 USB 3.1 Controller (C step) [Alpine Ridge 2C 2016]
           +-1d.0-[3b]----00.0  Sandisk Corp WD Black SN770 NVMe SSD
           +-1d.5-[3c]----00.0  Realtek Semiconductor Co., Ltd. Device 2502
           +-1d.6-[3d]----00.0  Intel Corporation Wi-Fi 6 AX210/AX211/AX411 160MHz
           +-1f.0  Intel Corporation HM470 Chipset LPC/eSPI Controller
           +-1f.3  Intel Corporation Cannon Lake PCH cAVS
           +-1f.4  Intel Corporation Cannon Lake PCH SMBus Controller
           \-1f.5  Intel Corporation Cannon Lake PCH SPI Controller


Checking slp_s0_debug_status:

Your system ModPHY Lane Core domain power gating state is OK for S0ix entry.

Your system Main PLL and Oscillator Crystal PLL state are OK for S0ix entry.

Your system CSMe power gating state is OK for S0ix entry.


ModPHY and CSMe subsystem power gating status are OK

---

20230627-20-17-s0ix-output.log


---Check S2idle path S0ix Residency---:

The system OS Kernel version is:
Linux centauro 6.3.8-200.fc38.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Jun 15 02:15:40 UTC 2023 x86_64 GNU/Linux

---Check whether your system supports S0ix or not---:

Low Power S0 Idle is:1
Your system supports low power S0 idle capability.



---Check whether intel_pmc_core sysfs files exit---:

The pmc_core debug sysfs files are OK on your system.



---Judge PC10, S0ix residency available status---:
Test system does not support S0ix.y substate

Turbostat output: 
17.904717 sec
CPU%c1	CPU%c6	CPU%c7	GFX%rc6	Pkg%pc2	Pkg%pc3	Pkg%pc6	Pkg%pc7	Pkg%pc8	Pkg%pc9	Pk%pc10	SYS%LPI
1.49	0.96	96.29	5810.93	3.61	28.96	0.14	0.00	0.09	0.00	58.79	0.00
2.54	1.62	93.99	5813.35	3.62	28.97	0.14	0.00	0.09	0.00	58.80	0.00
2.53
1.24	1.07	95.56
2.20
1.61	1.07	95.96
1.62
0.65	0.57	98.00
0.88
0.85	0.61	96.57
2.10
0.73	0.85	97.66
0.90

CPU Core C7 residency after S2idle is: 96.29
GFX RC6 residency after S2idle is: 5810.93
CPU Package C-state 2 residency after S2idle is: 3.61
CPU Package C-state 3 residency after S2idle is: 28.96
CPU Package C-state 8 residency after S2idle is: 0.09
CPU Package C-state 9 residency after S2idle is: 0.00
CPU Package C-state 10 residency after S2idle is: 58.79
S0ix residency after S2idle is: 0.00

Need to debug which IP blocked S0ix since PC10 is observed.

---Debug S0ix failure scenario--PCH IP power gating check---:

Your system south port controller did not meet S0ix requirement: [31mSPF[0m

---Debug S0ix failure scenario--Setting No ACPI DSM Callback---:

S0ix residency is available after setting no ACPI DSM callback.

---

It seems that maybe what is at fault here is the Thunderbolt controller?
It doesn't seem like there's a firmware update for Thunderbolt wither from fwupdate/LVFS or via the Dell website.
Comment 1 Mateus Rodrigues Costa 2023-06-28 01:40:59 UTC
I ran the tool two more times:

First one:

---Check S2idle path S0ix Residency---:

The system OS Kernel version is:
Linux centauro 6.3.8-200.fc38.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Jun 15 02:15:40 UTC 2023 x86_64 GNU/Linux

---Check whether your system supports S0ix or not---:

Low Power S0 Idle is:1
Your system supports low power S0 idle capability.



---Check whether intel_pmc_core sysfs files exit---:

The pmc_core debug sysfs files are OK on your system.



---Judge PC10, S0ix residency available status---:
cat: /sys/kernel/debug/pmc_core/substate_residencies: Arquivo ou diretório inexistente
grep: /sys/kernel/debug/pmc_core/substate_residencies: Arquivo ou diretório inexistente
Test system does not support S0ix.y substate

Turbostat output: 
18.090928 sec
CPU%c1	CPU%c6	CPU%c7	GFX%rc6	Pkg%pc2	Pkg%pc3	Pkg%pc6	Pkg%pc7	Pkg%pc8	Pkg%pc9	Pk%pc10	SYS%LPI
1.45	0.92	96.43	17950.49	2.73	28.12	0.15	0.00	0.05	0.00	61.20	0.02
1.38	1.16	95.85	17959.60	2.73	28.13	0.15	0.00	0.05	0.00	61.22	0.02
1.70
1.73	0.93	94.73
3.49
0.83	1.56	96.33
1.56
0.97	0.61	97.56
0.77
1.65	0.38	97.23
0.87
1.60	0.91	96.88
0.80

CPU Core C7 residency after S2idle is: 96.43
GFX RC6 residency after S2idle is: 17950.49
CPU Package C-state 2 residency after S2idle is: 2.73
CPU Package C-state 3 residency after S2idle is: 28.12
CPU Package C-state 8 residency after S2idle is: 0.05
CPU Package C-state 9 residency after S2idle is: 0.00
CPU Package C-state 10 residency after S2idle is: 61.20
S0ix residency after S2idle is: 0.02
cat: /sys/kernel/debug/pmc_core/substate_residencies: Arquivo ou diretório inexistente

Congratulations! Your system achieved S2idle S0ix residency: 0.02

Second one:

---Check S2idle path S0ix Residency---:

The system OS Kernel version is:
Linux centauro 6.3.8-200.fc38.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Jun 15 02:15:40 UTC 2023 x86_64 GNU/Linux

---Check whether your system supports S0ix or not---:

Low Power S0 Idle is:1
Your system supports low power S0 idle capability.



---Check whether intel_pmc_core sysfs files exit---:

The pmc_core debug sysfs files are OK on your system.



---Judge PC10, S0ix residency available status---:
cat: /sys/kernel/debug/pmc_core/substate_residencies: Arquivo ou diretório inexistente
grep: /sys/kernel/debug/pmc_core/substate_residencies: Arquivo ou diretório inexistente
Test system does not support S0ix.y substate

Turbostat output: 
17.809692 sec
CPU%c1	CPU%c6	CPU%c7	GFX%rc6	Pkg%pc2	Pkg%pc3	Pkg%pc6	Pkg%pc7	Pkg%pc8	Pkg%pc9	Pk%pc10	SYS%LPI
1.42	0.83	96.62	18939.77	2.79	28.37	0.17	0.00	0.15	0.00	60.63	0.00
2.99	1.04	95.13	18939.54	2.79	28.37	0.17	0.00	0.15	0.00	60.63	0.00
1.09
1.20	0.65	95.64
3.05
1.10	0.42	97.97
0.73
1.37	0.95	97.12
0.90
0.89	0.65	96.92
1.66
1.15	1.26	96.93
0.93

CPU Core C7 residency after S2idle is: 96.62
GFX RC6 residency after S2idle is: 18939.77
CPU Package C-state 2 residency after S2idle is: 2.79
CPU Package C-state 3 residency after S2idle is: 28.37
CPU Package C-state 8 residency after S2idle is: 0.15
CPU Package C-state 9 residency after S2idle is: 0.00
CPU Package C-state 10 residency after S2idle is: 60.63
S0ix residency after S2idle is: 0.00
cat: /sys/kernel/debug/pmc_core/substate_residencies: Arquivo ou diretório inexistente

Need to debug which IP blocked S0ix since PC10 is observed.

---Debug S0ix failure scenario--PCH IP power gating check---:

Your system south port controller did not meet S0ix requirement: SPF
PCH IP: 54 - SPF                             	State: On

---Debug S0ix failure scenario--Setting No ACPI DSM Callback---:

S0ix residency is available after setting no ACPI DSM callback.

---

So, it seems that it can achieve S0ix sleep sometimes, but either very little or soemthing prevents it sometimes.
Comment 2 Mateus Rodrigues Costa 2023-06-28 12:16:47 UTC
I let it sleep overnight without connecting to the charger, it apparently consumed ~20% of the battery.

Here are logs:

jun 27 22:42:19 centauro systemd[1]: Reached target sleep.target - Sleep.
jun 27 22:42:19 centauro wpa_supplicant[1482]: wlp61s0: CTRL-EVENT-DSCP-POLICY clear_all
jun 27 22:42:19 centauro systemd[1]: Starting nvidia-suspend.service - NVIDIA system suspend actions...
jun 27 22:42:19 centauro suspend[34601]: nvidia-suspend.service
jun 27 22:42:19 centauro logger[34601]: <13>Jun 27 22:42:19 suspend: nvidia-suspend.service
jun 27 22:42:19 centauro wpa_supplicant[1482]: wlp61s0: CTRL-EVENT-DSCP-POLICY clear_all
jun 27 22:42:19 centauro wpa_supplicant[1482]: nl80211: deinit ifname=wlp61s0 disabled_11b_rates=0
jun 27 22:42:19 centauro /usr/libexec/gdm-x-session[2262]: (**) Option "fd" "83"
jun 27 22:42:19 centauro /usr/libexec/gdm-x-session[2262]: (II) event9  - Video Bus: device removed
jun 27 22:42:19 centauro /usr/libexec/gdm-x-session[2262]: (**) Option "fd" "80"
jun 27 22:42:19 centauro /usr/libexec/gdm-x-session[2262]: (II) event10 - Video Bus: device removed
jun 27 22:42:19 centauro /usr/libexec/gdm-x-session[2262]: (**) Option "fd" "58"
jun 27 22:42:19 centauro /usr/libexec/gdm-x-session[2262]: (II) event1  - Power Button: device removed
jun 27 22:42:19 centauro /usr/libexec/gdm-x-session[2262]: (**) Option "fd" "66"
jun 27 22:42:19 centauro /usr/libexec/gdm-x-session[2262]: (II) event2  - Sleep Button: device removed
jun 27 22:42:19 centauro /usr/libexec/gdm-x-session[2262]: (**) Option "fd" "81"
jun 27 22:42:19 centauro /usr/libexec/gdm-x-session[2262]: (II) event4  - Logitech G203 LIGHTSYNC Gaming Mouse: device removed
jun 27 22:42:19 centauro /usr/libexec/gdm-x-session[2262]: (**) Option "fd" "84"
jun 27 22:42:19 centauro /usr/libexec/gdm-x-session[2262]: (**) Option "fd" "88"
jun 27 22:42:19 centauro /usr/libexec/gdm-x-session[2262]: (II) event7  - DELL08EA:00 06CB:CCA8 Mouse: device removed
jun 27 22:42:19 centauro /usr/libexec/gdm-x-session[2262]: (**) Option "fd" "82"
jun 27 22:42:19 centauro /usr/libexec/gdm-x-session[2262]: (II) event8  - DELL08EA:00 06CB:CCA8 Touchpad: device removed
jun 27 22:42:19 centauro /usr/libexec/gdm-x-session[2262]: (**) Option "fd" "56"
jun 27 22:42:19 centauro /usr/libexec/gdm-x-session[2262]: (II) event11 - Intel HID events: device removed
jun 27 22:42:19 centauro /usr/libexec/gdm-x-session[2262]: (**) Option "fd" "59"
jun 27 22:42:19 centauro /usr/libexec/gdm-x-session[2262]: (II) event12 - Intel HID 5 button array: device removed
jun 27 22:42:19 centauro /usr/libexec/gdm-x-session[2262]: (**) Option "fd" "86"
jun 27 22:42:19 centauro /usr/libexec/gdm-x-session[2262]: (II) event14 - Dell WMI hotkeys: device removed
jun 27 22:42:19 centauro /usr/libexec/gdm-x-session[2262]: (**) Option "fd" "85"
jun 27 22:42:19 centauro /usr/libexec/gdm-x-session[2262]: (II) event3  - AT Translated Set 2 keyboard: device removed
jun 27 22:42:19 centauro /usr/libexec/gdm-x-session[2262]: (**) Option "fd" "84"
jun 27 22:42:19 centauro /usr/libexec/gdm-x-session[2262]: (II) event5  - Logitech G203 LIGHTSYNC Gaming Mouse Keyboard: device removed
jun 27 22:42:19 centauro /usr/libexec/gdm-x-session[2262]: (II) AIGLX: Suspending AIGLX clients for VT switch
jun 27 22:42:20 centauro kernel: rfkill: input handler enabled
jun 27 22:42:20 centauro bluetoothd[1122]: Endpoint unregistered: sender=:1.388 path=/MediaEndpoint/A2DPSource/ldac
jun 27 22:42:20 centauro bluetoothd[1122]: Endpoint unregistered: sender=:1.388 path=/MediaEndpoint/A2DPSink/aac
jun 27 22:42:20 centauro gsd-media-keys[2756]: gvc_mixer_card_get_index: assertion 'GVC_IS_MIXER_CARD (card)' failed
jun 27 22:42:20 centauro bluetoothd[1122]: Endpoint unregistered: sender=:1.388 path=/MediaEndpoint/A2DPSource/aac
jun 27 22:42:20 centauro gsd-media-keys[2756]: gvc_mixer_card_get_index: assertion 'GVC_IS_MIXER_CARD (card)' failed
jun 27 22:42:20 centauro bluetoothd[1122]: Endpoint unregistered: sender=:1.388 path=/MediaEndpoint/A2DPSink/sbc
jun 27 22:42:20 centauro gsd-media-keys[2756]: gvc_mixer_card_get_index: assertion 'GVC_IS_MIXER_CARD (card)' failed
jun 27 22:42:20 centauro bluetoothd[1122]: Endpoint unregistered: sender=:1.388 path=/MediaEndpoint/A2DPSource/sbc
jun 27 22:42:20 centauro gsd-media-keys[2756]: gvc_mixer_card_get_index: assertion 'GVC_IS_MIXER_CARD (card)' failed
jun 27 22:42:20 centauro bluetoothd[1122]: Endpoint unregistered: sender=:1.388 path=/MediaEndpoint/A2DPSink/sbc_xq
jun 27 22:42:20 centauro gsd-media-keys[2756]: gvc_mixer_card_get_index: assertion 'GVC_IS_MIXER_CARD (card)' failed
jun 27 22:42:20 centauro bluetoothd[1122]: Endpoint unregistered: sender=:1.388 path=/MediaEndpoint/A2DPSource/sbc_xq
jun 27 22:42:20 centauro gsd-media-keys[2756]: gvc_mixer_card_get_index: assertion 'GVC_IS_MIXER_CARD (card)' failed
jun 27 22:42:20 centauro bluetoothd[1122]: Endpoint unregistered: sender=:1.388 path=/MediaEndpoint/A2DPSource/faststream
jun 27 22:42:20 centauro gsd-media-keys[2756]: gvc_mixer_card_get_index: assertion 'GVC_IS_MIXER_CARD (card)' failed
jun 27 22:42:20 centauro bluetoothd[1122]: Endpoint unregistered: sender=:1.388 path=/MediaEndpoint/A2DPSource/faststream_duplex
jun 27 22:42:20 centauro gsd-media-keys[2756]: gvc_mixer_card_get_index: assertion 'GVC_IS_MIXER_CARD (card)' failed
jun 27 22:42:20 centauro bluetoothd[1122]: Endpoint unregistered: sender=:1.388 path=/MediaEndpoint/A2DPSink/opus_05
jun 27 22:42:20 centauro gsd-media-keys[2756]: gvc_mixer_card_get_index: assertion 'GVC_IS_MIXER_CARD (card)' failed
jun 27 22:42:20 centauro bluetoothd[1122]: Endpoint unregistered: sender=:1.388 path=/MediaEndpoint/A2DPSource/opus_05
jun 27 22:42:20 centauro gsd-media-keys[2756]: gvc_mixer_card_get_index: assertion 'GVC_IS_MIXER_CARD (card)' failed
jun 27 22:42:20 centauro bluetoothd[1122]: Endpoint unregistered: sender=:1.388 path=/MediaEndpoint/A2DPSink/opus_05_duplex
jun 27 22:42:20 centauro gsd-media-keys[2756]: Unable to get default source
jun 27 22:42:20 centauro bluetoothd[1122]: Endpoint unregistered: sender=:1.388 path=/MediaEndpoint/A2DPSource/opus_05_duplex
jun 27 22:42:20 centauro gsd-media-keys[2756]: Unable to get default sink
jun 27 22:42:20 centauro gsd-media-keys[2756]: gvc_mixer_card_get_index: assertion 'GVC_IS_MIXER_CARD (card)' failed
jun 27 22:42:20 centauro gsd-media-keys[2756]: gvc_mixer_card_get_index: assertion 'GVC_IS_MIXER_CARD (card)' failed
jun 27 22:42:20 centauro gsd-media-keys[2756]: gvc_mixer_card_get_index: assertion 'GVC_IS_MIXER_CARD (card)' failed
jun 27 22:42:20 centauro gsd-media-keys[2756]: gvc_mixer_card_get_index: assertion 'GVC_IS_MIXER_CARD (card)' failed
jun 27 22:42:20 centauro gsd-media-keys[2756]: gvc_mixer_card_get_index: assertion 'GVC_IS_MIXER_CARD (card)' failed
jun 27 22:42:20 centauro gsd-media-keys[2756]: gvc_mixer_card_get_index: assertion 'GVC_IS_MIXER_CARD (card)' failed
jun 27 22:42:20 centauro gsd-media-keys[2756]: gvc_mixer_card_get_index: assertion 'GVC_IS_MIXER_CARD (card)' failed
jun 27 22:42:20 centauro gsd-media-keys[2756]: gvc_mixer_card_get_index: assertion 'GVC_IS_MIXER_CARD (card)' failed
jun 27 22:42:20 centauro gsd-media-keys[2756]: gvc_mixer_card_get_index: assertion 'GVC_IS_MIXER_CARD (card)' failed
jun 27 22:42:20 centauro gsd-media-keys[2756]: gvc_mixer_card_get_index: assertion 'GVC_IS_MIXER_CARD (card)' failed
jun 27 22:42:20 centauro /usr/libexec/gdm-x-session[2262]: (II) systemd-logind: got pause for 13:75
jun 27 22:42:20 centauro /usr/libexec/gdm-x-session[2262]: (II) systemd-logind: got pause for 13:76
jun 27 22:42:20 centauro /usr/libexec/gdm-x-session[2262]: (II) systemd-logind: got pause for 226:0
jun 27 22:42:20 centauro /usr/libexec/gdm-x-session[2262]: (II) systemd-logind: got pause for 13:71
jun 27 22:42:20 centauro /usr/libexec/gdm-x-session[2262]: (II) systemd-logind: got pause for 13:65
jun 27 22:42:20 centauro /usr/libexec/gdm-x-session[2262]: (II) systemd-logind: got pause for 13:66
jun 27 22:42:20 centauro /usr/libexec/gdm-x-session[2262]: (II) systemd-logind: got pause for 13:74
jun 27 22:42:20 centauro /usr/libexec/gdm-x-session[2262]: (II) systemd-logind: got pause for 13:68
jun 27 22:42:20 centauro /usr/libexec/gdm-x-session[2262]: (II) systemd-logind: got pause for 13:72
jun 27 22:42:20 centauro /usr/libexec/gdm-x-session[2262]: (II) systemd-logind: got pause for 13:73
jun 27 22:42:20 centauro /usr/libexec/gdm-x-session[2262]: (II) systemd-logind: got pause for 13:69
jun 27 22:42:20 centauro /usr/libexec/gdm-x-session[2262]: (II) systemd-logind: got pause for 13:67
jun 27 22:42:20 centauro /usr/libexec/gdm-x-session[2262]: (II) systemd-logind: got pause for 13:78
jun 27 22:42:20 centauro uresourced[1456]: Setting resources on user-1000.slice (MemoryMin: 0, MemoryLow: 0, CPUWeight: 100, IOWeight: 100)
jun 27 22:42:20 centauro uresourced[1456]: Setting resources on user@1000.service (MemoryMin: 0, MemoryLow: 0, CPUWeight: 100, IOWeight: 100)
jun 27 22:42:20 centauro uresourced[1456]: Setting resources on user.slice (MemoryMin: 0, MemoryLow: 0, CPUWeight: -, IOWeight: -)
jun 27 22:42:20 centauro systemd[1]: nvidia-suspend.service: Deactivated successfully.
jun 27 22:42:20 centauro systemd[1]: Finished nvidia-suspend.service - NVIDIA system suspend actions.
jun 27 22:42:20 centauro audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=nvidia-suspend comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
jun 27 22:42:20 centauro audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=nvidia-suspend comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
jun 27 22:42:20 centauro systemd[1]: Starting systemd-suspend.service - System Suspend...
jun 27 22:42:20 centauro systemd-sleep[34609]: Entering sleep state 'suspend'...
jun 27 22:42:20 centauro kernel: PM: suspend entry (s2idle)
jun 27 22:42:20 centauro kernel: Filesystems sync: 0.016 seconds
jun 27 22:42:20 centauro kernel: PM: Preparing system for sleep (s2idle)
jun 28 09:07:00 centauro kernel: Freezing user space processes
jun 28 09:07:00 centauro kernel: Freezing user space processes completed (elapsed 0.001 seconds)
jun 28 09:07:00 centauro kernel: OOM killer disabled.
jun 28 09:07:00 centauro kernel: Freezing remaining freezable tasks
jun 28 09:07:00 centauro kernel: Freezing remaining freezable tasks completed (elapsed 0.001 seconds)
jun 28 09:07:00 centauro kernel: PM: Suspending system (s2idle)
jun 28 09:07:00 centauro kernel: PM: suspend of devices complete after 3069.355 msecs
jun 28 09:07:00 centauro kernel: PM: start suspend of devices complete after 3069.550 msecs
jun 28 09:07:00 centauro kernel: PM: suspend devices took 3.070 seconds
jun 28 09:07:00 centauro kernel: PM: late suspend of devices complete after 14.218 msecs
jun 28 09:07:00 centauro kernel: ACPI: EC: interrupt blocked
jun 28 09:07:00 centauro kernel: intel_pch_thermal 0000:00:12.0: CPU-PCH is cool [49C] after 2000 ms delay
jun 28 09:07:00 centauro kernel: PM: noirq suspend of devices complete after 2150.088 msecs
jun 28 09:07:00 centauro kernel: PM: suspend-to-idle
jun 28 09:07:00 centauro kernel: Timekeeping suspended for 2917.461 seconds
jun 28 09:07:00 centauro kernel: PM: Triggering wakeup from IRQ 9
jun 28 09:07:00 centauro kernel: ACPI: EC: ACPI EC GPE status set
jun 28 09:07:00 centauro kernel: ACPI: EC: ACPI EC GPE dispatched
jun 28 09:07:00 centauro kernel: ACPI: EC: ACPI EC work flushed
jun 28 09:07:00 centauro kernel: ACPI: PM: Rearming ACPI SCI for wakeup
jun 28 09:07:00 centauro kernel: PM: Triggering wakeup from IRQ 9
jun 28 09:07:00 centauro kernel: ACPI: PM: Rearming ACPI SCI for wakeup
jun 28 09:07:00 centauro kernel: PM: Triggering wakeup from IRQ 9
jun 28 09:07:00 centauro kernel: ACPI: EC: ACPI EC GPE status set
jun 28 09:07:00 centauro kernel: ACPI: PM: Rearming ACPI SCI for wakeup
jun 28 09:07:00 centauro kernel: Timekeeping suspended for 34551.905 seconds
jun 28 09:07:00 centauro kernel: PM: Triggering wakeup from IRQ 9
jun 28 09:07:00 centauro kernel: ACPI: EC: ACPI EC GPE status set
jun 28 09:07:00 centauro kernel: ACPI: EC: ACPI EC GPE dispatched
jun 28 09:07:00 centauro kernel: ACPI: EC: ACPI EC work flushed
jun 28 09:07:00 centauro kernel: ACPI: PM: Wakeup after ACPI Notify sync
jun 28 09:07:00 centauro kernel: PM: resume from suspend-to-idle
jun 28 09:07:00 centauro kernel: ACPI: EC: interrupt unblocked
jun 28 09:07:00 centauro kernel: PM: noirq resume of devices complete after 2846.151 msecs
jun 28 09:07:00 centauro kernel: PM: early resume of devices complete after 1.237 msecs
jun 28 09:07:00 centauro kernel: iwlwifi 0000:3d:00.0: WRT: Invalid buffer destination
jun 28 09:07:00 centauro kernel: xhci_hcd 0000:01:00.2: xHC error in resume, USBSTS 0x401, Reinit
jun 28 09:07:00 centauro kernel: usb usb3: root hub lost power or was reset
jun 28 09:07:00 centauro kernel: usb usb4: root hub lost power or was reset
jun 28 09:07:00 centauro kernel: iwlwifi 0000:3d:00.0: WFPM_UMAC_PD_NOTIFICATION: 0x1f
jun 28 09:07:00 centauro kernel: iwlwifi 0000:3d:00.0: WFPM_LMAC2_PD_NOTIFICATION: 0x1f
jun 28 09:07:00 centauro kernel: iwlwifi 0000:3d:00.0: WFPM_AUTH_KEY_0: 0x80
jun 28 09:07:00 centauro kernel: iwlwifi 0000:3d:00.0: CNVI_SCU_SEQ_DATA_DW9: 0x0
jun 28 09:07:00 centauro kernel: ata1: SATA link down (SStatus 4 SControl 300)
jun 28 09:07:00 centauro kernel: PM: resume of devices complete after 2380.710 msecs
jun 28 09:07:00 centauro kernel: PM: resume devices took 2.393 seconds
jun 28 09:07:00 centauro kernel: PM: Finishing wakeup.
jun 28 09:07:00 centauro kernel: mei_hdcp 0000:00:16.0-b638ab7e-94e2-4ea2-a552-d1c54b627f04: bound 0000:00:02.0 (ops i915_hdcp_component_ops [i915])
jun 28 09:07:00 centauro kernel: OOM killer enabled.
jun 28 09:07:00 centauro kernel: Restarting tasks ... 
jun 28 09:07:00 centauro kernel: usb 1-3: USB disconnect, device number 2
jun 28 09:07:00 centauro kernel: done.
jun 28 09:07:00 centauro kernel: random: crng reseeded on system resumption
jun 28 09:07:00 centauro systemd-resolved[1088]: Clock change detected. Flushing caches.
jun 28 09:07:00 centauro systemd-logind[1132]: Lid opened.
jun 28 09:07:00 centauro sssd_kcm[20356]: Shutting down (status = 0)
jun 28 09:07:00 centauro systemd[1]: NetworkManager-dispatcher.service: Deactivated successfully.
jun 28 09:07:00 centauro audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=NetworkManager-dispatcher comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
jun 28 09:07:00 centauro systemd[1]: sssd-kcm.service: Deactivated successfully.
jun 28 09:07:00 centauro audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=sssd-kcm comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
jun 28 09:07:00 centauro systemd[1]: sssd-kcm.service: Consumed 2.489s CPU time.
jun 28 09:07:00 centauro /usr/libexec/gdm-x-session[2262]: (II) config/udev: removing device Logitech G203 LIGHTSYNC Gaming Mouse
jun 28 09:07:00 centauro /usr/libexec/gdm-x-session[2262]: (II) UnloadModule: "libinput"
jun 28 09:07:00 centauro /usr/libexec/gdm-x-session[2262]: (II) systemd-logind: releasing fd for 13:68
jun 28 09:07:00 centauro /usr/libexec/gdm-x-session[2262]: (EE) systemd-logind: failed to release device: Device not taken
jun 28 09:07:00 centauro /usr/libexec/gdm-x-session[2262]: (II) config/udev: removing device Logitech G203 LIGHTSYNC Gaming Mouse Keyboard
jun 28 09:07:00 centauro /usr/libexec/gdm-x-session[2262]: (II) UnloadModule: "libinput"
jun 28 09:07:00 centauro /usr/libexec/gdm-x-session[2262]: (II) systemd-logind: not releasing fd for 13:69, still in use
jun 28 09:07:00 centauro /usr/libexec/gdm-x-session[2262]: (II) config/udev: removing device Logitech G203 LIGHTSYNC Gaming Mouse Keyboard
jun 28 09:07:00 centauro systemd[1]: Starting sssd-kcm.service - SSSD Kerberos Cache Manager...
jun 28 09:07:00 centauro /usr/libexec/gdm-x-session[2262]: (II) UnloadModule: "libinput"
jun 28 09:07:00 centauro /usr/libexec/gdm-x-session[2262]: (II) systemd-logind: releasing fd for 13:69
jun 28 09:07:00 centauro systemd[1]: Starting unbound-anchor.service - update of the root trust anchor for DNSSEC validation in unbound...
jun 28 09:07:00 centauro systemd[1]: logrotate.service - Rotate log files was skipped because of an unmet condition check (ConditionACPower=true).
jun 28 09:07:00 centauro systemd[1]: Started sssd-kcm.service - SSSD Kerberos Cache Manager.
jun 28 09:07:00 centauro audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=sssd-kcm comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
jun 28 09:07:00 centauro fwupd[3258]: 12:07:00.897 FuPluginIntelMe      failed to get public key using /fpf/OemCred: generic failure [0xb]
jun 28 09:07:00 centauro audit[34721]: AVC avc:  denied  { map } for  pid=34721 comm="unbound-anchor" path="/etc/ld.so.cache" dev="dm-0" ino=3587289 scontext=system_u:system_r:named_t:s0 tcontext=system_u:object_r:etc_t:s0 tclass=file permissive=0
jun 28 09:07:00 centauro sssd_kcm[34720]: Starting up
jun 28 09:07:00 centauro systemd[1]: unbound-anchor.service: Deactivated successfully.
jun 28 09:07:00 centauro systemd-sleep[34609]: System returned from sleep state.
jun 28 09:07:00 centauro kernel: PM: suspend exit
jun 28 09:07:00 centauro systemd[1]: Finished unbound-anchor.service - update of the root trust anchor for DNSSEC validation in unbound.
jun 28 09:07:00 centauro audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=unbound-anchor comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
jun 28 09:07:00 centauro audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=unbound-anchor comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
jun 28 09:07:01 centauro gdm[1422]: GLib: Source ID 116 was not found when attempting to remove it
jun 28 09:07:01 centauro systemd[1]: systemd-suspend.service: Deactivated successfully.
jun 28 09:07:01 centauro systemd[1]: Finished systemd-suspend.service - System Suspend.
jun 28 09:07:01 centauro audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=systemd-suspend comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
jun 28 09:07:01 centauro audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=systemd-suspend comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
jun 28 09:07:01 centauro systemd[1]: Stopped target sleep.target - Sleep.
jun 28 09:07:01 centauro systemd[1]: Reached target suspend.target - Suspend.
jun 28 09:07:01 centauro /usr/libexec/gdm-x-session[2262]: (II) systemd-logind: got resume for 13:75
jun 28 09:07:01 centauro /usr/libexec/gdm-x-session[2262]: (II) systemd-logind: got resume for 13:76
jun 28 09:07:01 centauro /usr/libexec/gdm-x-session[2262]: (II) systemd-logind: got resume for 226:0
jun 28 09:07:01 centauro /usr/libexec/gdm-x-session[2262]: (II) AIGLX: Resuming AIGLX clients after VT switch
jun 28 09:07:01 centauro systemd[1]: Starting nvidia-resume.service - NVIDIA system resume actions...
jun 28 09:07:01 centauro systemd[1]: Stopped target suspend.target - Suspend.
jun 28 09:07:01 centauro suspend[34729]: nvidia-resume.service
jun 28 09:07:01 centauro logger[34729]: <13>Jun 28 09:07:01 suspend: nvidia-resume.service
jun 28 09:07:01 centauro systemd[1]: nvidia-resume.service: Deactivated successfully.
jun 28 09:07:01 centauro systemd[1]: Finished nvidia-resume.service - NVIDIA system resume actions.
jun 28 09:07:01 centauro audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=nvidia-resume comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
jun 28 09:07:01 centauro audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=nvidia-resume comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
jun 28 09:07:01 centauro systemd-logind[1132]: Operation 'sleep' finished.
Comment 3 Mateus Rodrigues Costa 2023-06-28 14:22:40 UTC
Ok, after further investigation, I think I made some progress.

Besides the `NVreg_EnableS0ixPowerManagement=1` option for the nvidia driver, I now have also enabled fine-grained runtime power management with `NVreg_DynamicPowerManagement=0x02`. Apparently thanks to that I seem to always be able to hit S0ix sleep according to Intel's tool.

For example, from the latest test:

---Check S2idle path S0ix Residency---:

The system OS Kernel version is:
Linux centauro 6.3.8-200.fc38.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Jun 15 02:15:40 UTC 2023 x86_64 GNU/Linux

---Check whether your system supports S0ix or not---:

Low Power S0 Idle is:1
Your system supports low power S0 idle capability.



---Check whether intel_pmc_core sysfs files exit---:

The pmc_core debug sysfs files are OK on your system.



---Judge PC10, S0ix residency available status---:
cat: /sys/kernel/debug/pmc_core/substate_residencies: Arquivo ou diretório inexistente
grep: /sys/kernel/debug/pmc_core/substate_residencies: Arquivo ou diretório inexistente
Test system does not support S0ix.y substate

Turbostat output: 
18.372234 sec
CPU%c1	CPU%c6	CPU%c7	GFX%rc6	Pkg%pc2	Pkg%pc3	Pkg%pc6	Pkg%pc7	Pkg%pc8	Pkg%pc9	Pk%pc10	SYS%LPI
1.76	1.03	95.83	10248.80	4.62	82.55	0.11	0.21	0.16	0.00	2.18	0.09
0.90	2.44	95.12	10248.70	4.62	82.55	0.11	0.21	0.16	0.00	2.17	0.09
1.76
1.16	0.55	94.79
4.21
1.08	0.68	97.68
1.07
4.08	0.60	94.81
0.73
0.94	0.66	97.73
0.98
1.28	1.28	94.85
2.97

CPU Core C7 residency after S2idle is: 95.83
GFX RC6 residency after S2idle is: 10248.80
CPU Package C-state 2 residency after S2idle is: 4.62
CPU Package C-state 3 residency after S2idle is: 82.55
CPU Package C-state 8 residency after S2idle is: 0.16
CPU Package C-state 9 residency after S2idle is: 0.00
CPU Package C-state 10 residency after S2idle is: 2.18
S0ix residency after S2idle is: 0.09
cat: /sys/kernel/debug/pmc_core/substate_residencies: Arquivo ou diretório inexistente

Congratulations! Your system achieved S2idle S0ix residency: 0.09

What seems to be a problem is that S0ix residency seems to usually be very low for some reason.

The Intel S0ix Troubleshooting (https://01.org/blogs/qwang59/2020/linux-s0ix-troubleshooting) asks to run the following command to check PC10 residency if S0ix residency is not good:

$ sudo ./turbostat --show Pkg%pc2,Pkg%pc3,Pkg%pc6,Pkg%pc7,Pkg%pc8,Pkg%pc9,Pk%pc10,SYS%LPI rtcwake -m freeze -s 60
turbostat version 2022.04.16 - Len Brown <lenb@kernel.org>
Kernel command line: BOOT_IMAGE=(hd0,gpt2)/ostree/fedora-31ba4ff85000c2eb2a1d5d71ee7d913c73ce3987138ae1c614698cfccba56d53/vmlinuz-6.3.8-200.fc38.x86_64 rd.luks.uuid=luks-454d172a-55a8-4f47-b1e5-2b4cb16b47d0 rhgb quiet root=UUID=12237539-3686-4f05-8530-e5d56b34d4f5 rootflags=subvol=root rw ostree=/ostree/boot.0/fedora/31ba4ff85000c2eb2a1d5d71ee7d913c73ce3987138ae1c614698cfccba56d53/0 rd.driver.blacklist=nouveau modprobe.blacklist=nouveau nvidia-drm.modeset=1 intel_iommu=on nosgx intel_pmc_core.warn_on_s0ix_failures=1
CPUID(0): GenuineIntel 0x16 CPUID levels
CPUID(1): family:model:stepping 0x6:9e:a (6:158:10) microcode 0xf2
CPUID(0x80000000): max_extended_levels: 0x80000008
CPUID(1): SSE3 MONITOR - EIST TM2 TSC MSR ACPI-TM HT TM
CPUID(6): APERF, TURBO, DTS, PTM, HWP, HWPnotify, HWPwindow, HWPepp, No-HWPpkg, EPB
cpu1: MSR_IA32_MISC_ENABLE: 0x00850089 (TCC EIST MWAIT PREFETCH TURBO)
CPUID(7): SGX
cpu1: MSR_IA32_FEATURE_CONTROL: 0x00020005 (Locked )
CPUID(0x15): eax_crystal: 2 ebx_tsc: 216 ecx_crystal_hz: 0
TSC: 2592 MHz (24000000 Hz * 216 / 2 / 1000000)
CPUID(0x16): base_mhz: 2600 max_mhz: 4500 bus_mhz: 100
cpu1: MSR_MISC_PWR_MGMT: 0x00401cc0 (ENable-EIST_Coordination DISable-EPB DISable-OOB)
RAPL: 5825 sec. Joule Counter Range, at 45 Watts
cpu1: MSR_PLATFORM_INFO: 0x8083bf1011a00
8 * 100.0 = 800.0 MHz max efficiency frequency
26 * 100.0 = 2600.0 MHz base frequency
cpu1: MSR_IA32_POWER_CTL: 0x002c005d (C1E auto-promotion: DISabled)
cpu1: MSR_TURBO_RATIO_LIMIT: 0x28292a2b2c2d
40 * 100.0 = 4000.0 MHz max turbo 6 active cores
41 * 100.0 = 4100.0 MHz max turbo 5 active cores
42 * 100.0 = 4200.0 MHz max turbo 4 active cores
43 * 100.0 = 4300.0 MHz max turbo 3 active cores
44 * 100.0 = 4400.0 MHz max turbo 2 active cores
45 * 100.0 = 4500.0 MHz max turbo 1 active cores
cpu1: MSR_CONFIG_TDP_NOMINAL: 0x0000001a (base_ratio=26)
cpu1: MSR_CONFIG_TDP_LEVEL_1: 0x00160118 (PKG_MIN_PWR_LVL1=0 PKG_MAX_PWR_LVL1=0 LVL1_RATIO=22 PKG_TDP_LVL1=280)
cpu1: MSR_CONFIG_TDP_LEVEL_2: 0x00000000 ()
cpu1: MSR_CONFIG_TDP_CONTROL: 0x00000000 ( lock=0)
cpu1: MSR_TURBO_ACTIVATION_RATIO: 0x00000019 (MAX_NON_TURBO_RATIO=25 lock=0)
cpu1: MSR_PKG_CST_CONFIG_CONTROL: 0x1e008008 (UNdemote-C3, UNdemote-C1, demote-C3, demote-C1, locked, pkg-cstate-limit=8 (unlimited))
/dev/cpu_dma_latency: 2000000000 usec (default)
current_driver: intel_idle
current_governor: menu
current_governor_ro: menu
cpu1: POLL: CPUIDLE CORE POLL IDLE
cpu1: C1: MWAIT 0x00
cpu1: C1E: MWAIT 0x01
cpu1: C3: MWAIT 0x10
cpu1: C6: MWAIT 0x20
cpu1: C7s: MWAIT 0x33
cpu1: C8: MWAIT 0x40
cpu1: C9: MWAIT 0x50
cpu1: C10: MWAIT 0x60
cpu1: cpufreq driver: intel_pstate
cpu1: cpufreq governor: powersave
cpufreq intel_pstate no_turbo: 0
cpu1: MSR_MISC_FEATURE_CONTROL: 0x00000000 (L2-Prefetch L2-Prefetch-pair L1-Prefetch L1-IP-Prefetch)
cpu0: MSR_PM_ENABLE: 0x00000001 (HWP)
cpu0: MSR_HWP_CAPABILITIES: 0x01091a2d (high 45 guar 26 eff 9 low 1)
cpu0: MSR_HWP_REQUEST: 0x80002d08 (min 8 max 45 des 0 epp 0x80 window 0x0 pkg 0x0)
cpu0: MSR_HWP_INTERRUPT: 0x00000001 (EN_Guaranteed_Perf_Change, Dis_Excursion_Min)
cpu0: MSR_HWP_STATUS: 0x00000000 (No-Guaranteed_Perf_Change, No-Excursion_Min)
cpu0: EPB: 6 (balanced)
cpu0: MSR_RAPL_POWER_UNIT: 0x000a0e03 (0.125000 Watts, 0.000061 Joules, 0.000977 sec.)
cpu0: MSR_PKG_POWER_INFO: 0x00000168 (45 W TDP, RAPL 0 - 0 W, 0.000000 sec.)
cpu0: MSR_PKG_POWER_LIMIT: 0x4202d000dc8640 (UNlocked)
cpu0: PKG Limit #1: ENabled (200.000 Watts, 28.000000 sec, clamp DISabled)
cpu0: PKG Limit #2: DISabled (90.000 Watts, 0.002441* sec, clamp DISabled)
cpu0: MSR_VR_CURRENT_CONFIG: 0x00000550
cpu0: PKG Limit #4: 170.000000 Watts (UNlocked)
cpu0: MSR_DRAM_POWER_LIMIT: 0x5400de00000000 (UNlocked)
cpu0: DRAM Limit: DISabled (0.000 Watts, 0.000977 sec, clamp DISabled)
cpu0: MSR_PP0_POLICY: 0
cpu0: MSR_PP0_POWER_LIMIT: 0x00000000 (UNlocked)
cpu0: Cores Limit: DISabled (0.000 Watts, 0.000977 sec, clamp DISabled)
cpu0: MSR_PP1_POLICY: 0
cpu0: MSR_PP1_POWER_LIMIT: 0x00000000 (UNlocked)
cpu0: GFX Limit: DISabled (0.000 Watts, 0.000977 sec, clamp DISabled)
cpu0: MSR_IA32_TEMPERATURE_TARGET: 0x00640000 (100 C) (100 default - 0 offset)
cpu0: MSR_IA32_PACKAGE_THERM_STATUS: 0x88370800 (45 C)
cpu0: MSR_IA32_PACKAGE_THERM_INTERRUPT: 0x00000003 (100 C, 100 C)
cpu1: MSR_PKGC3_IRTL: 0x0000884e (valid, 79872 ns)
cpu1: MSR_PKGC6_IRTL: 0x00008876 (valid, 120832 ns)
cpu1: MSR_PKGC7_IRTL: 0x00008894 (valid, 151552 ns)
cpu1: MSR_PKGC8_IRTL: 0x000088fa (valid, 256000 ns)
cpu1: MSR_PKGC9_IRTL: 0x0000894c (valid, 339968 ns)
cpu1: MSR_PKGC10_IRTL: 0x00008bf2 (valid, 1034240 ns)
rtcwake: acordar de "freeze" usando /dev/rtc0 em Wed Jun 28 14:11:26 2023
64.357359 sec
Pkg%pc2	Pkg%pc3	Pkg%pc6	Pkg%pc7	Pkg%pc8	Pkg%pc9	Pk%pc10	SYS%LPI
0.92	9.65	0.04	0.00	0.05	0.00	86.35	24.05
0.92	9.65	0.04	0.00	0.05	0.00	86.35	24.05
Comment 4 Mateus Rodrigues Costa 2023-06-28 19:34:39 UTC
Further investigating, this time I actually disabled Secure boot. Apparently sometimes it works fine and sometimes it doesn't.

Here's logs form when it didn't work with Secure Boot disabled:

First:


---Check S2idle path S0ix Residency---:

The system OS Kernel version is:
Linux centauro 6.3.8-200.fc38.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Jun 15 02:15:40 UTC 2023 x86_64 GNU/Linux

---Check whether your system supports S0ix or not---:

Low Power S0 Idle is:1
Your system supports low power S0 idle capability.



---Check whether intel_pmc_core sysfs files exit---:

The pmc_core debug sysfs files are OK on your system.



---Judge PC10, S0ix residency available status---:
Test system does not support S0ix.y substate

Turbostat output: 
18.384933 sec
CPU%c1	CPU%c6	CPU%c7	GFX%rc6	Pkg%pc2	Pkg%pc3	Pkg%pc6	Pkg%pc7	Pkg%pc8	Pkg%pc9	Pk%pc10	SYS%LPI
1.42	0.79	96.43	858.44	4.11	27.51	0.25	3.89	0.11	0.00	55.41	0.00
2.32	0.62	95.62	858.45	4.11	27.51	0.25	3.89	0.11	0.00	55.41	0.00
1.38
0.95	0.67	96.24
1.99
0.73	0.73	97.55
0.93
0.92	1.15	95.71
2.33
0.89	0.84	97.50
0.85
1.58	0.73	95.99
2.15

CPU Core C7 residency after S2idle is: 96.43
GFX RC6 residency after S2idle is: 858.44
CPU Package C-state 2 residency after S2idle is: 4.11
CPU Package C-state 3 residency after S2idle is: 27.51
CPU Package C-state 8 residency after S2idle is: 0.11
CPU Package C-state 9 residency after S2idle is: 0.00
CPU Package C-state 10 residency after S2idle is: 55.41
S0ix residency after S2idle is: 0.00

Need to debug which IP blocked S0ix since PC10 is observed.

---Debug S0ix failure scenario--PCH IP power gating check---:

Your system south port controller did not meet S0ix requirement: [31mSPC[0m

---Debug S0ix failure scenario--Setting No ACPI DSM Callback---:

Setting no ACPI DSM callback is not helpful to the S0ix residency.

---Debug PCIeport D states and link PM states---

Checking PCI Devices D3 States:
[  182.522722] snd_hda_intel 0000:00:1f.3: PCI PM: Suspend power state: D3hot
[  182.523047] nvidia-gpu 0000:01:00.3: PCI PM: Suspend power state: D3hot
[  182.524216] xhci_hcd 0000:01:00.2: PCI PM: Suspend power state: D3hot
[  182.529831] nvme 0000:3b:00.0: PCI PM: Suspend power state: D0
[  182.529833] nvme 0000:3b:00.0: PCI PM: Skipped
[  182.534292] i801_smbus 0000:00:1f.4: PCI PM: Suspend power state: D0
[  182.534294] i801_smbus 0000:00:1f.4: PCI PM: Skipped
[  182.535199] i915 0000:00:02.0: PCI PM: Suspend power state: D3hot
[  182.536947] snd_hda_intel 0000:01:00.1: PCI PM: Suspend power state: D3hot
[  182.537770] pcieport 0000:00:1d.0: PCI PM: Suspend power state: D0
[  182.537772] pcieport 0000:00:1d.0: PCI PM: Skipped
[  182.549223] mei_me 0000:00:16.0: PCI PM: Suspend power state: D3hot
[  182.550286] thunderbolt 0000:04:00.0: PCI PM: Suspend power state: D3hot
[  182.550402] iwlwifi 0000:3d:00.0: PCI PM: Suspend power state: D3hot
[  182.550477] r8169 0000:3c:00.0: PCI PM: Suspend power state: D3hot
[  182.550549] xhci_hcd 0000:3a:00.0: PCI PM: Suspend power state: D3hot
[  182.550648] proc_thermal 0000:00:04.0: PCI PM: Suspend power state: D3hot
[  182.551720] intel-lpss 0000:00:15.1: PCI PM: Suspend power state: D3hot
[  182.551894] xhci_hcd 0000:00:14.0: PCI PM: Suspend power state: D3hot
[  182.551912] nvidia 0000:01:00.0: PCI PM: Suspend power state: D3hot
[  182.552176] ahci 0000:00:17.0: PCI PM: Suspend power state: D3hot
[  182.563007] pcieport 0000:03:00.0: PCI PM: Suspend power state: D3hot
[  182.563040] pcieport 0000:00:1d.6: PCI PM: Suspend power state: D3hot
[  182.563217] pcieport 0000:03:02.0: PCI PM: Suspend power state: D3hot
[  182.563700] pcieport 0000:00:1d.5: PCI PM: Suspend power state: D3hot
[  182.576901] pcieport 0000:02:00.0: PCI PM: Suspend power state: D3hot
[  182.703177] pcieport 0000:00:01.0: PCI PM: Suspend power state: D3cold
[  184.663370] pcieport 0000:00:1b.0: PCI PM: Suspend power state: D3cold
[  190.450546] intel_pch_thermal 0000:00:12.0: PCI PM: Suspend power state: D3hot


Checking PCI Devices tree diagram:
-[0000:00]-+-00.0  Intel Corporation 8th Gen Core Processor Host Bridge/DRAM Registers
           +-01.0-[01]--+-00.0  NVIDIA Corporation TU116M [GeForce GTX 1660 Ti Mobile]
           |            +-00.1  NVIDIA Corporation TU116 High Definition Audio Controller
           |            +-00.2  NVIDIA Corporation TU116 USB 3.1 Host Controller
           |            \-00.3  NVIDIA Corporation TU116 USB Type-C UCSI Controller
           +-02.0  Intel Corporation CoffeeLake-H GT2 [UHD Graphics 630]
           +-04.0  Intel Corporation Xeon E3-1200 v5/E3-1500 v5/6th Gen Core Processor Thermal Subsystem
           +-08.0  Intel Corporation Xeon E3-1200 v5/v6 / E3-1500 v5 / 6th/7th/8th Gen Core Processor Gaussian Mixture Model
           +-12.0  Intel Corporation Cannon Lake PCH Thermal Controller
           +-14.0  Intel Corporation Cannon Lake PCH USB 3.1 xHCI Host Controller
           +-14.2  Intel Corporation Cannon Lake PCH Shared SRAM
           +-15.0  Intel Corporation Cannon Lake PCH Serial IO I2C Controller #0
           +-15.1  Intel Corporation Cannon Lake PCH Serial IO I2C Controller #1
           +-16.0  Intel Corporation Cannon Lake PCH HECI Controller
           +-17.0  Intel Corporation Cannon Lake Mobile PCH SATA AHCI Controller
           +-1b.0-[02-3a]----00.0-[03-3a]--+-00.0-[04]----00.0  Intel Corporation JHL6340 Thunderbolt 3 NHI (C step) [Alpine Ridge 2C 2016]
           |                               +-01.0-[05-39]--
           |                               \-02.0-[3a]----00.0  Intel Corporation JHL6340 Thunderbolt 3 USB 3.1 Controller (C step) [Alpine Ridge 2C 2016]
           +-1d.0-[3b]----00.0  Sandisk Corp WD Black SN770 NVMe SSD
           +-1d.5-[3c]----00.0  Realtek Semiconductor Co., Ltd. Device 2502
           +-1d.6-[3d]----00.0  Intel Corporation Wi-Fi 6 AX210/AX211/AX411 160MHz
           +-1f.0  Intel Corporation HM470 Chipset LPC/eSPI Controller
           +-1f.3  Intel Corporation Cannon Lake PCH cAVS
           +-1f.4  Intel Corporation Cannon Lake PCH SMBus Controller
           \-1f.5  Intel Corporation Cannon Lake PCH SPI Controller

The pcieport 0000:00:1d.0 ASPM enable status:
		LnkCtl:	ASPM L1 Enabled; RCB 64 bytes, Disabled- CommClk+

Pcieport is not in D3cold:          
[31m0000:00:1d.0[0m

Pcieport is not in D3cold:     
[31m0000:03:00.0
0000:00:1d.6
0000:03:02.0
0000:00:1d.5
0000:02:00.0[0m


0000:00:01.0 Link is in Detect

The link power management state of PCIe bridge: 0000:00:01.0 is OK.

The PCIe bridge link power management state is:
[31m0000:00:1b.0 Link is in L0[0m

The link power management state of PCIe bridge: [31m0000:00:1b.0[0m is not expected. 
which is expected to be L1.1 or L1.2, or user would run this script again.


The L1SubCap of the failed 0000:00:1b.0 is:


The L1SubCtl1 of the failed 0000:00:1b.0 is:



Checking PCI Devices tree diagram:
-[0000:00]-+-00.0  Intel Corporation 8th Gen Core Processor Host Bridge/DRAM Registers
           +-01.0-[01]--+-00.0  NVIDIA Corporation TU116M [GeForce GTX 1660 Ti Mobile]
           |            +-00.1  NVIDIA Corporation TU116 High Definition Audio Controller
           |            +-00.2  NVIDIA Corporation TU116 USB 3.1 Host Controller
           |            \-00.3  NVIDIA Corporation TU116 USB Type-C UCSI Controller
           +-02.0  Intel Corporation CoffeeLake-H GT2 [UHD Graphics 630]
           +-04.0  Intel Corporation Xeon E3-1200 v5/E3-1500 v5/6th Gen Core Processor Thermal Subsystem
           +-08.0  Intel Corporation Xeon E3-1200 v5/v6 / E3-1500 v5 / 6th/7th/8th Gen Core Processor Gaussian Mixture Model
           +-12.0  Intel Corporation Cannon Lake PCH Thermal Controller
           +-14.0  Intel Corporation Cannon Lake PCH USB 3.1 xHCI Host Controller
           +-14.2  Intel Corporation Cannon Lake PCH Shared SRAM
           +-15.0  Intel Corporation Cannon Lake PCH Serial IO I2C Controller #0
           +-15.1  Intel Corporation Cannon Lake PCH Serial IO I2C Controller #1
           +-16.0  Intel Corporation Cannon Lake PCH HECI Controller
           +-17.0  Intel Corporation Cannon Lake Mobile PCH SATA AHCI Controller
           +-1b.0-[02-3a]----00.0-[03-3a]--+-00.0-[04]----00.0  Intel Corporation JHL6340 Thunderbolt 3 NHI (C step) [Alpine Ridge 2C 2016]
           |                               +-01.0-[05-39]--
           |                               \-02.0-[3a]----00.0  Intel Corporation JHL6340 Thunderbolt 3 USB 3.1 Controller (C step) [Alpine Ridge 2C 2016]
           +-1d.0-[3b]----00.0  Sandisk Corp WD Black SN770 NVMe SSD
           +-1d.5-[3c]----00.0  Realtek Semiconductor Co., Ltd. Device 2502
           +-1d.6-[3d]----00.0  Intel Corporation Wi-Fi 6 AX210/AX211/AX411 160MHz
           +-1f.0  Intel Corporation HM470 Chipset LPC/eSPI Controller
           +-1f.3  Intel Corporation Cannon Lake PCH cAVS
           +-1f.4  Intel Corporation Cannon Lake PCH SMBus Controller
           \-1f.5  Intel Corporation Cannon Lake PCH SPI Controller


Checking slp_s0_debug_status:

Your system ModPHY lane Core domain has issue blocks S0ix.

Isolation suggestions:     
Check ModPHY related high speed I/O controller list:     
covering from XHCI, XDCI, SATA, PCIe (all instances), Gbe and SCC (UFS)

Your system Main PLL or Oscillator Crystal PLL has issue to power off during S2idle, which may block S0ix.     
Failed PLL: MAIN_PLL_OFF 

Second:


---Check S2idle path S0ix Residency---:

The system OS Kernel version is:
Linux centauro 6.3.8-200.fc38.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Jun 15 02:15:40 UTC 2023 x86_64 GNU/Linux

---Check whether your system supports S0ix or not---:

Low Power S0 Idle is:1
Your system supports low power S0 idle capability.



---Check whether intel_pmc_core sysfs files exit---:

The pmc_core debug sysfs files are OK on your system.



---Judge PC10, S0ix residency available status---:
Test system does not support S0ix.y substate

Turbostat output: 
17.865222 sec
CPU%c1	CPU%c6	CPU%c7	GFX%rc6	Pkg%pc2	Pkg%pc3	Pkg%pc6	Pkg%pc7	Pkg%pc8	Pkg%pc9	Pk%pc10	SYS%LPI
1.53	0.98	96.14	1586.01	3.44	75.93	0.14	0.01	0.10	0.00	10.37	0.00
2.26	2.35	92.95	1586.00	3.44	75.93	0.14	0.01	0.10	0.00	10.37	0.00
2.77
1.19	0.94	95.76
2.30
2.61	0.44	96.08
0.82
0.86	0.80	97.55
0.69
1.23	0.80	97.43
0.62
1.26	0.57	97.03
1.79

CPU Core C7 residency after S2idle is: 96.14
GFX RC6 residency after S2idle is: 1586.01
CPU Package C-state 2 residency after S2idle is: 3.44
CPU Package C-state 3 residency after S2idle is: 75.93
CPU Package C-state 8 residency after S2idle is: 0.10
CPU Package C-state 9 residency after S2idle is: 0.00
CPU Package C-state 10 residency after S2idle is: 10.37
S0ix residency after S2idle is: 0.00

Need to debug which IP blocked S0ix since PC10 is observed.

---Debug S0ix failure scenario--PCH IP power gating check---:

Your system south port controller power gating state is OK after 30 seconds runtime check.

Checking slp_s0_debug_status:

Your system ModPHY lane Core domain has issue blocks S0ix.

Isolation suggestions:     
Check ModPHY related high speed I/O controller list:     
covering from XHCI, XDCI, SATA, PCIe (all instances), Gbe and SCC (UFS)

Your system Main PLL or Oscillator Crystal PLL has issue to power off during S2idle, which may block S0ix.     
Failed PLL: MAIN_PLL_OFF 

Do note that second one apparently borked the system, apparently breaking logind .

The latest suspend logs from journalctl -k:

jun 28 15:43:51 centauro kernel: PM: suspend entry (s2idle)
jun 28 15:43:51 centauro kernel: Filesystems sync: 0.000 seconds
jun 28 15:43:51 centauro kernel: PM: Preparing system for sleep (s2idle)
jun 28 15:43:51 centauro kernel: rfkill: input handler enabled
jun 28 15:44:10 centauro kernel: Freezing user space processes
jun 28 15:44:10 centauro kernel: Freezing user space processes completed (elapsed 0.032 seconds)
jun 28 15:44:10 centauro kernel: OOM killer disabled.
jun 28 15:44:10 centauro kernel: Freezing remaining freezable tasks
jun 28 15:44:10 centauro kernel: Freezing remaining freezable tasks completed (elapsed 0.001 seconds)
jun 28 15:44:10 centauro kernel: PM: Suspending system (s2idle)
jun 28 15:44:10 centauro kernel: wlp61s0: deauthenticating from 00:eb:d8:58:a6:b4 by local choice (Reason: 3=DEAUTH_LEAVING)
jun 28 15:44:10 centauro kernel: xhci_hcd 0000:01:00.2: xHC error in resume, USBSTS 0x401, Reinit
jun 28 15:44:10 centauro kernel: usb usb3: root hub lost power or was reset
jun 28 15:44:10 centauro kernel: usb usb4: root hub lost power or was reset
jun 28 15:44:10 centauro kernel: PM: suspend of devices complete after 2943.746 msecs
jun 28 15:44:10 centauro kernel: PM: start suspend of devices complete after 2943.943 msecs
jun 28 15:44:10 centauro kernel: PM: suspend devices took 2.944 seconds
jun 28 15:44:10 centauro kernel: PM: late suspend of devices complete after 14.022 msecs
jun 28 15:44:10 centauro kernel: snd_hda_intel 0000:00:1f.3: PCI PM: Suspend power state: D3hot
jun 28 15:44:10 centauro kernel: xhci_hcd 0000:01:00.2: PCI PM: Suspend power state: D3hot
jun 28 15:44:10 centauro kernel: nvme 0000:3b:00.0: PCI PM: Suspend power state: D0
jun 28 15:44:10 centauro kernel: nvme 0000:3b:00.0: PCI PM: Skipped
jun 28 15:44:10 centauro kernel: ACPI: EC: interrupt blocked
jun 28 15:44:10 centauro kernel: i801_smbus 0000:00:1f.4: PCI PM: Suspend power state: D0
jun 28 15:44:10 centauro kernel: i801_smbus 0000:00:1f.4: PCI PM: Skipped
jun 28 15:44:10 centauro kernel: i915 0000:00:02.0: PCI PM: Suspend power state: D3hot
jun 28 15:44:10 centauro kernel: snd_hda_intel 0000:01:00.1: PCI PM: Suspend power state: D3hot
jun 28 15:44:10 centauro kernel: pcieport 0000:00:1d.0: PCI PM: Suspend power state: D0
jun 28 15:44:10 centauro kernel: pcieport 0000:00:1d.0: PCI PM: Skipped
jun 28 15:44:10 centauro kernel: thunderbolt 0000:04:00.0: PCI PM: Suspend power state: D3hot
jun 28 15:44:10 centauro kernel: r8169 0000:3c:00.0: PCI PM: Suspend power state: D3hot
jun 28 15:44:10 centauro kernel: mei_me 0000:00:16.0: PCI PM: Suspend power state: D3hot
jun 28 15:44:10 centauro kernel: iwlwifi 0000:3d:00.0: PCI PM: Suspend power state: D3hot
jun 28 15:44:10 centauro kernel: xhci_hcd 0000:3a:00.0: PCI PM: Suspend power state: D3hot
jun 28 15:44:10 centauro kernel: proc_thermal 0000:00:04.0: PCI PM: Suspend power state: D3hot
jun 28 15:44:10 centauro kernel: intel-lpss 0000:00:15.1: PCI PM: Suspend power state: D3hot
jun 28 15:44:10 centauro kernel: ahci 0000:00:17.0: PCI PM: Suspend power state: D3hot
jun 28 15:44:10 centauro kernel: xhci_hcd 0000:00:14.0: PCI PM: Suspend power state: D3hot
jun 28 15:44:10 centauro kernel: nvidia 0000:01:00.0: PCI PM: Suspend power state: D3hot
jun 28 15:44:10 centauro kernel: pcieport 0000:03:00.0: PCI PM: Suspend power state: D3hot
jun 28 15:44:10 centauro kernel: pcieport 0000:00:1d.6: PCI PM: Suspend power state: D3hot
jun 28 15:44:10 centauro kernel: pcieport 0000:00:1d.5: PCI PM: Suspend power state: D3hot
jun 28 15:44:10 centauro kernel: pcieport 0000:03:02.0: PCI PM: Suspend power state: D3hot
jun 28 15:44:10 centauro kernel: pcieport 0000:02:00.0: PCI PM: Suspend power state: D3hot
jun 28 15:44:10 centauro kernel: pcieport 0000:00:01.0: PCI PM: Suspend power state: D3cold
jun 28 15:44:10 centauro kernel: pcieport 0000:00:1b.0: PCI PM: Suspend power state: D3cold
jun 28 15:44:10 centauro kernel: PM: Triggering wakeup from IRQ 9
jun 28 15:44:10 centauro kernel: intel_pch_thermal 0000:00:12.0: Wakeup event detected, abort cooling
jun 28 15:44:10 centauro kernel: intel_pch_thermal 0000:00:12.0: PCI PM: Suspend power state: D3hot
jun 28 15:44:10 centauro kernel: PM: noirq suspend of devices complete after 12097.768 msecs
jun 28 15:44:10 centauro kernel: PM: suspend-to-idle
jun 28 15:44:10 centauro kernel: ACPI: PM: ACPI fixed event wakeup
jun 28 15:44:10 centauro kernel: PM: resume from suspend-to-idle
jun 28 15:44:10 centauro kernel: ACPI: EC: interrupt unblocked
jun 28 15:44:10 centauro kernel: PM: noirq resume of devices complete after 2828.138 msecs
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: CPU did not enter SLP_S0!!! (S0ix cnt=0)
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: AUDIO_D3                                State: Yes
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: OTG_D3                                  State: Yes
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: XHCI_D3                                 State: Yes
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: LPIO_D3                                 State: Yes
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: SDX_D3                                  State: Yes
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: SATA_D3                                 State: Yes
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: UFS0_D3                                 State: No
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: UFS1_D3                                 State: No
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: EMMC_D3                                 State: No
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: SDIO_PLL_OFF                            State: Yes
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: USB2_PLL_OFF                            State: Yes
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: AUDIO_PLL_OFF                           State: Yes
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: OC_PLL_OFF                              State: Yes
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: MAIN_PLL_OFF                            State: No
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: XOSC_OFF                                State: No
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: LPC_CLKS_GATED                          State: Yes
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: PCIE_CLKREQS_IDLE                       State: Yes
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: AUDIO_ROSC_OFF                          State: Yes
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: HPET_XOSC_CLK_REQ                       State: Yes
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: PMC_ROSC_SLOW_CLK                       State: No
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: AON2_ROSC_GATED                         State: Yes
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: CLKACKS_DEASSERTED                      State: No
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: MPHY_CORE_GATED                         State: No
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: CSME_GATED                              State: Yes
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: USB2_SUS_GATED                          State: No
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: DYN_FLEX_IO_IDLE                        State: Yes
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: GBE_NO_LINK                             State: Yes
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: THERM_SEN_DISABLED                      State: No
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: PCIE_LOW_POWER                          State: No
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: ISH_VNNAON_REQ_ACT                      State: Yes
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: ISH_VNN_REQ_ACT                         State: No
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: CNV_VNNAON_REQ_ACT                      State: No
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: CNV_VNN_REQ_ACT                         State: No
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: NPK_VNNON_REQ_ACT                       State: No
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: PMSYNC_STATE_IDLE                       State: Yes
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: ALST_GT_THRES                           State: Yes
jun 28 15:44:10 centauro kernel: intel_pmc_core INT33A1:00: SLP_S0_DBG: PMC_ARC_PG_READY                        State: No
jun 28 15:44:10 centauro kernel: PM: early resume of devices complete after 1.508 msecs
jun 28 15:44:10 centauro kernel: iwlwifi 0000:3d:00.0: WRT: Invalid buffer destination
jun 28 15:44:10 centauro kernel: r8169 0000:3c:00.0 enp60s0: Link is Down
jun 28 15:44:10 centauro kernel: iwlwifi 0000:3d:00.0: WFPM_UMAC_PD_NOTIFICATION: 0x1f
jun 28 15:44:10 centauro kernel: iwlwifi 0000:3d:00.0: WFPM_LMAC2_PD_NOTIFICATION: 0x1f
jun 28 15:44:10 centauro kernel: iwlwifi 0000:3d:00.0: WFPM_AUTH_KEY_0: 0x80
jun 28 15:44:10 centauro kernel: iwlwifi 0000:3d:00.0: CNVI_SCU_SEQ_DATA_DW9: 0x0
jun 28 15:44:10 centauro kernel: ata1: SATA link down (SStatus 4 SControl 300)
jun 28 15:44:10 centauro kernel: xhci_hcd 0000:01:00.2: xHC error in resume, USBSTS 0x401, Reinit
jun 28 15:44:10 centauro kernel: usb usb3: root hub lost power or was reset
jun 28 15:44:10 centauro kernel: usb usb4: root hub lost power or was reset
jun 28 15:44:10 centauro kernel: PM: resume of devices complete after 683.863 msecs
jun 28 15:44:10 centauro kernel: PM: resume devices took 0.697 seconds
jun 28 15:44:10 centauro kernel: PM: Finishing wakeup.
jun 28 15:44:10 centauro kernel: mei_hdcp 0000:00:16.0-b638ab7e-94e2-4ea2-a552-d1c54b627f04: bound 0000:00:02.0 (ops i915_hdcp_component_ops [i915])
jun 28 15:44:10 centauro kernel: OOM killer enabled.
jun 28 15:44:10 centauro kernel: Restarting tasks ... done.
jun 28 15:44:10 centauro kernel: random: crng reseeded on system resumption
jun 28 15:44:10 centauro kernel: PM: suspend exit

Note You need to log in before you can comment on or make changes to this bug.