Bug 219220 - nvme nvme0: I/O timeout, completion polled
Summary: nvme nvme0: I/O timeout, completion polled
Status: NEW
Alias: None
Product: IO/Storage
Classification: Unclassified
Component: NVMe (show other bugs)
Hardware: Intel Linux
: P3 high
Assignee: IO/NVME Virtual Default Assignee
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2024-09-02 07:24 UTC by Fabiano Taioli
Modified: 2024-09-03 12:59 UTC (History)
0 users

See Also:
Kernel Version: 6.10.7
Subsystem:
Regression: No
Bisected commit-id:


Attachments
PCI/USB Devices, Kernel Modules, Journal log (127.21 KB, text/plain)
2024-09-02 07:24 UTC, Fabiano Taioli
Details

Description Fabiano Taioli 2024-09-02 07:24:08 UTC
Created attachment 306804 [details]
PCI/USB Devices, Kernel Modules, Journal log

On Linux installed on new laptop the system is randomly unresponsive, and boot time is really slow.

Looking to logs I see timeouts related to NVME

kernel: nvme nvme0: I/O tag 192 (60c0) QID 7 timeout, completion polled

Tried to solve adding nvme_core.default_ps_max_latency_us=0 to kernel parameters.
This mitigated the problem, but not totally resolved.

My kernel
Kernel version: Linux msi 6.10.7-arch1-1 #1 SMP PREEMPT_DYNAMIC Thu, 29 Aug 2024 16:48:57 +0000 x86_64 GNU/Linux

See attached logs

Laptop specs: meteor lake,  Intel core Ultra 7 (windows looks like unaffected, so I think hardware problems can be excluded).
Comment 1 Fabiano Taioli 2024-09-03 06:54:03 UTC
Looks like problem was caused by Intel Volume Management Device (Intel VMD).

Disabling VMD totally solved the problem. Could be a bug in kernel VMD driver?
Comment 2 Artem S. Tashkinov 2024-09-03 08:57:41 UTC
> Disabling VMD totally solved the problem.

Disabling where and how?
Comment 3 Fabiano Taioli 2024-09-03 09:16:51 UTC
I disabled VMD directly from BIOS (Advanced > Systen Agent > VMD).

On my MSI laptop was necessary to enable "Advanced Bios" with keys combination (Hold ALT, Hold Right Control, Hold Shift, And Press F2 while holding those 3 buttons) to access the option.
Comment 4 Artem S. Tashkinov 2024-09-03 12:37:36 UTC
Looks like you're not alone and VMD support under Linux is lacking:

https://www.reddit.com/r/archlinux/comments/yes44f/psa_disable_vmd_on_an_intel_laptop_if_you_have/
Comment 5 Fabiano Taioli 2024-09-03 12:59:23 UTC
I see (2 years old post). Never heard of Intel VMD before. Reading about It, is not clear to me the utility of having it on 13in ultra-portable laptop. Turning it off does not seems to have any negative effect, even Windows started without complains. So I think I will keep it disabled forever. But if anyone want to try some fix and need me to test it (on https://github.com/torvalds/linux/commits/master/drivers/pci/controller/vmd.c module?!) is welcome.

Note You need to log in before you can comment on or make changes to this bug.