Bug 100671 - vmwrite error in vmx_vcpu_run
Summary: vmwrite error in vmx_vcpu_run
Status: RESOLVED CODE_FIX
Alias: None
Product: Virtualization
Classification: Unclassified
Component: kvm (show other bugs)
Hardware: Intel Linux
: P1 normal
Assignee: virtualization_kvm
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2015-06-29 13:50 UTC by Lidong Chen
Modified: 2015-09-01 17:06 UTC (History)
4 users (show)

See Also:
Kernel Version: 4.1.0+
Subsystem:
Regression: No
Bisected commit-id:


Attachments
dmesg.txt (81.96 KB, text/plain)
2015-06-29 13:50 UTC, Lidong Chen
Details
another one dmesg (88.50 KB, text/plain)
2015-07-03 12:24 UTC, Andrey Smetanin
Details
With this patch(commit revert) the bug disappears (2.78 KB, patch)
2015-07-03 17:01 UTC, Andrey Smetanin
Details | Diff

Description Lidong Chen 2015-06-29 13:50:09 UTC
Created attachment 181321 [details]
dmesg.txt

[ 1614.416934] vmwrite error: reg 6820 value 6 (err 1)
[ 1614.416939] CPU: 1 PID: 15701 Comm: qemu-system-x86 Not tainted 4.1.0+ #7
[ 1614.416940] Hardware name: LENOVO 2356BG6/2356BG6, BIOS G7ET94WW (2.54 ) 04/30/2013
[ 1614.416941]  0000000000000000 000000006138f41b ffff880007d1fc98 ffffffff8166ab0d
[ 1614.416943]  0000000000000000 ffff880007c78000 ffff880007d1fca8 ffffffffa082121a
[ 1614.416945]  ffff880007d1fcb8 ffffffffa082123f ffff880007d1fcc8 ffffffffa08215ba
[ 1614.416946] Call Trace:
[ 1614.416952]  [<ffffffff8166ab0d>] dump_stack+0x45/0x57
[ 1614.416961]  [<ffffffffa082121a>] vmwrite_error+0x2a/0x30 [kvm_intel]
[ 1614.416963]  [<ffffffffa082123f>] vmcs_writel+0x1f/0x30 [kvm_intel]
[ 1614.416966]  [<ffffffffa08215ba>] vmx_set_rflags+0x3a/0x40 [kvm_intel]
[ 1614.416978]  [<ffffffffa07a97fa>] __kvm_set_rflags+0x4a/0x60 [kvm]
[ 1614.416985]  [<ffffffffa07af7a0>] x86_emulate_instruction+0x590/0x740 [kvm]
[ 1614.416988]  [<ffffffff810863b1>] ? __set_task_blocked+0x41/0xa0
[ 1614.416995]  [<ffffffffa07afc6c>] complete_emulated_pio+0x3c/0x60 [kvm]
[ 1614.417003]  [<ffffffffa07b34bc>] kvm_arch_vcpu_ioctl_run+0x3cc/0x420 [kvm]
[ 1614.417009]  [<ffffffffa079b81e>] kvm_vcpu_ioctl+0x33e/0x600 [kvm]
[ 1614.417011]  [<ffffffff81204fa4>] do_vfs_ioctl+0x2c4/0x4a0
[ 1614.417013]  [<ffffffff8129e05d>] ? selinux_file_ioctl+0x4d/0xc0
[ 1614.417015]  [<ffffffff812051f9>] SyS_ioctl+0x79/0x90
[ 1614.417017]  [<ffffffff8167126e>] entry_SYSCALL_64_fastpath+0x12/0x71
[ 1614.417020] vmwrite error: reg c08 value 0 (err 1)
[ 1614.417021] CPU: 1 PID: 15701 Comm: qemu-system-x86 Not tainted 4.1.0+ #7
[ 1614.417022] Hardware name: LENOVO 2356BG6/2356BG6, BIOS G7ET94WW (2.54 ) 04/30/2013
[ 1614.417023]  0000000000000000 000000006138f41b ffff880007d1fc78 ffffffff8166ab0d
[ 1614.417024]  0000000000000000 ffff880007c78000 ffff880007d1fc88 ffffffffa082121a
[ 1614.417026]  ffff880007d1fc98 ffffffffa082123f ffff880007d1fcd8 ffffffffa0823bdc
[ 1614.417027] Call Trace:
[ 1614.417029]  [<ffffffff8166ab0d>] dump_stack+0x45/0x57
[ 1614.417032]  [<ffffffffa082121a>] vmwrite_error+0x2a/0x30 [kvm_intel]
[ 1614.417034]  [<ffffffffa082123f>] vmcs_writel+0x1f/0x30 [kvm_intel]
[ 1614.417036]  [<ffffffffa0823bdc>] vmx_save_host_state+0x1ac/0x1e0 [kvm_intel]
[ 1614.417043]  [<ffffffffa07ac577>] vcpu_enter_guest+0x4f7/0xdb0 [kvm]
[ 1614.417050]  [<ffffffffa07af7a0>] ? x86_emulate_instruction+0x590/0x740 [kvm]
[ 1614.417051]  [<ffffffff810863b1>] ? __set_task_blocked+0x41/0xa0
[ 1614.417058]  [<ffffffffa07b33e5>] kvm_arch_vcpu_ioctl_run+0x2f5/0x420 [kvm]
[ 1614.417063]  [<ffffffffa079b81e>] kvm_vcpu_ioctl+0x33e/0x600 [kvm]
[ 1614.417065]  [<ffffffff81204fa4>] do_vfs_ioctl+0x2c4/0x4a0
[ 1614.417067]  [<ffffffff8129e05d>] ? selinux_file_ioctl+0x4d/0xc0
[ 1614.417069]  [<ffffffff812051f9>] SyS_ioctl+0x79/0x90
[ 1614.417070]  [<ffffffff8167126e>] entry_SYSCALL_64_fastpath+0x12/0x71
[ 1614.417071] vmwrite error: reg c0a value 0 (err 1)
[ 1614.417073] CPU: 1 PID: 15701 Comm: qemu-system-x86 Not tainted 4.1.0+ #7
[ 1614.417073] Hardware name: LENOVO 2356BG6/2356BG6, BIOS G7ET94WW (2.54 ) 04/30/2013
[ 1614.417074]  0000000000000000 000000006138f41b ffff880007d1fc78 ffffffff8166ab0d
[ 1614.417075]  0000000000000000 ffff880007c78000 ffff880007d1fc88 ffffffffa082121a
[ 1614.417077]  ffff880007d1fc98 ffffffffa082123f ffff880007d1fcd8 ffffffffa0823acb
[ 1614.417078] Call Trace:
[ 1614.417080]  [<ffffffff8166ab0d>] dump_stack+0x45/0x57
[ 1614.417082]  [<ffffffffa082121a>] vmwrite_error+0x2a/0x30 [kvm_intel]
[ 1614.417084]  [<ffffffffa082123f>] vmcs_writel+0x1f/0x30 [kvm_intel]
[ 1614.417087]  [<ffffffffa0823acb>] vmx_save_host_state+0x9b/0x1e0 [kvm_intel]
[ 1614.417093]  [<ffffffffa07ac577>] vcpu_enter_guest+0x4f7/0xdb0 [kvm]
[ 1614.417099]  [<ffffffffa07af7a0>] ? x86_emulate_instruction+0x590/0x740 [kvm]
[ 1614.417100]  [<ffffffff810863b1>] ? __set_task_blocked+0x41/0xa0
[ 1614.417107]  [<ffffffffa07b33e5>] kvm_arch_vcpu_ioctl_run+0x2f5/0x420 [kvm]
[ 1614.417112]  [<ffffffffa079b81e>] kvm_vcpu_ioctl+0x33e/0x600 [kvm]
[ 1614.417114]  [<ffffffff81204fa4>] do_vfs_ioctl+0x2c4/0x4a0
[ 1614.417116]  [<ffffffff8129e05d>] ? selinux_file_ioctl+0x4d/0xc0
[ 1614.417117]  [<ffffffff812051f9>] SyS_ioctl+0x79/0x90
[ 1614.417119]  [<ffffffff8167126e>] entry_SYSCALL_64_fastpath+0x12/0x71
[ 1614.417120] vmwrite error: reg 6c06 value 7fab025dd700 (err 39704321)
[ 1614.417121] CPU: 1 PID: 15701 Comm: qemu-system-x86 Not tainted 4.1.0+ #7
[ 1614.417122] Hardware name: LENOVO 2356BG6/2356BG6, BIOS G7ET94WW (2.54 ) 04/30/2013
[ 1614.417122]  0000000000000000 000000006138f41b ffff880007d1fc78 ffffffff8166ab0d
[ 1614.417124]  0000000000000000 ffff880007c78000 ffff880007d1fc88 ffffffffa082121a
[ 1614.417125]  ffff880007d1fc98 ffffffffa082123f ffff880007d1fcd8 ffffffffa0823aff
[ 1614.417127] Call Trace:
[ 1614.417128]  [<ffffffff8166ab0d>] dump_stack+0x45/0x57
[ 1614.417130]  [<ffffffffa082121a>] vmwrite_error+0x2a/0x30 [kvm_intel]
[ 1614.417133]  [<ffffffffa082123f>] vmcs_writel+0x1f/0x30 [kvm_intel]
[ 1614.417135]  [<ffffffffa0823aff>] vmx_save_host_state+0xcf/0x1e0 [kvm_intel]
[ 1614.417141]  [<ffffffffa07ac577>] vcpu_enter_guest+0x4f7/0xdb0 [kvm]
[ 1614.417147]  [<ffffffffa07af7a0>] ? x86_emulate_instruction+0x590/0x740 [kvm]
[ 1614.417148]  [<ffffffff810863b1>] ? __set_task_blocked+0x41/0xa0
[ 1614.417155]  [<ffffffffa07b33e5>] kvm_arch_vcpu_ioctl_run+0x2f5/0x420 [kvm]
[ 1614.417160]  [<ffffffffa079b81e>] kvm_vcpu_ioctl+0x33e/0x600 [kvm]
[ 1614.417162]  [<ffffffff81204fa4>] do_vfs_ioctl+0x2c4/0x4a0
[ 1614.417164]  [<ffffffff8129e05d>] ? selinux_file_ioctl+0x4d/0xc0
[ 1614.417165]  [<ffffffff812051f9>] SyS_ioctl+0x79/0x90
[ 1614.417167]  [<ffffffff8167126e>] entry_SYSCALL_64_fastpath+0x12/0x71
[ 1614.417168] vmwrite error: reg 6c08 value ffff88013e240000 (err 1042546689)
[ 1614.417169] CPU: 1 PID: 15701 Comm: qemu-system-x86 Not tainted 4.1.0+ #7
[ 1614.417170] Hardware name: LENOVO 2356BG6/2356BG6, BIOS G7ET94WW (2.54 ) 04/30/2013
[ 1614.417170]  0000000000000000 000000006138f41b ffff880007d1fc78 ffffffff8166ab0d
[ 1614.417172]  0000000000000000 ffff880007c78000 ffff880007d1fc88 ffffffffa082121a
[ 1614.417173]  ffff880007d1fc98 ffffffffa082123f ffff880007d1fcd8 ffffffffa0823b21
[ 1614.417174] Call Trace:
[ 1614.417176]  [<ffffffff8166ab0d>] dump_stack+0x45/0x57
[ 1614.417178]  [<ffffffffa082121a>] vmwrite_error+0x2a/0x30 [kvm_intel]
[ 1614.417180]  [<ffffffffa082123f>] vmcs_writel+0x1f/0x30 [kvm_intel]
[ 1614.417183]  [<ffffffffa0823b21>] vmx_save_host_state+0xf1/0x1e0 [kvm_intel]
[ 1614.417189]  [<ffffffffa07ac577>] vcpu_enter_guest+0x4f7/0xdb0 [kvm]
[ 1614.417195]  [<ffffffffa07af7a0>] ? x86_emulate_instruction+0x590/0x740 [kvm]
[ 1614.417196]  [<ffffffff810863b1>] ? __set_task_blocked+0x41/0xa0
[ 1614.417202]  [<ffffffffa07b33e5>] kvm_arch_vcpu_ioctl_run+0x2f5/0x420 [kvm]
[ 1614.417208]  [<ffffffffa079b81e>] kvm_vcpu_ioctl+0x33e/0x600 [kvm]
[ 1614.417210]  [<ffffffff81204fa4>] do_vfs_ioctl+0x2c4/0x4a0
[ 1614.417211]  [<ffffffff8129e05d>] ? selinux_file_ioctl+0x4d/0xc0
[ 1614.417213]  [<ffffffff812051f9>] SyS_ioctl+0x79/0x90
[ 1614.417214]  [<ffffffff8167126e>] entry_SYSCALL_64_fastpath+0x12/0x71
[ 1614.417217] vmwrite error: reg 681e value ffffffff813fb328 (err -2126531839)
[ 1614.417218] CPU: 1 PID: 15701 Comm: qemu-system-x86 Not tainted 4.1.0+ #7
[ 1614.417219] Hardware name: LENOVO 2356BG6/2356BG6, BIOS G7ET94WW (2.54 ) 04/30/2013
[ 1614.417220]  0000000000000000 000000006138f41b ffff880007d1fc38 ffffffff8166ab0d
[ 1614.417221]  0000000000000000 ffff880007c78000 ffff880007d1fc48 ffffffffa082121a
[ 1614.417222]  ffff880007d1fc58 ffffffffa082123f ffff880007d1fcd8 ffffffffa082c231
[ 1614.417224] Call Trace:
[ 1614.417225]  [<ffffffff8166ab0d>] dump_stack+0x45/0x57
[ 1614.417228]  [<ffffffffa082121a>] vmwrite_error+0x2a/0x30 [kvm_intel]
[ 1614.417230]  [<ffffffffa082123f>] vmcs_writel+0x1f/0x30 [kvm_intel]
[ 1614.417233]  [<ffffffffa082c231>] vmx_vcpu_run+0x511/0x700 [kvm_intel]
[ 1614.417239]  [<ffffffffa07a2943>] ? kvm_set_shared_msr+0x83/0x90 [kvm]
[ 1614.417245]  [<ffffffffa07ac862>] vcpu_enter_guest+0x7e2/0xdb0 [kvm]
[ 1614.417251]  [<ffffffffa07af7a0>] ? x86_emulate_instruction+0x590/0x740 [kvm]
[ 1614.417252]  [<ffffffff810863b1>] ? __set_task_blocked+0x41/0xa0
[ 1614.417258]  [<ffffffffa07b33e5>] kvm_arch_vcpu_ioctl_run+0x2f5/0x420 [kvm]
[ 1614.417263]  [<ffffffffa079b81e>] kvm_vcpu_ioctl+0x33e/0x600 [kvm]
[ 1614.417265]  [<ffffffff81204fa4>] do_vfs_ioctl+0x2c4/0x4a0
[ 1614.417267]  [<ffffffff8129e05d>] ? selinux_file_ioctl+0x4d/0xc0
[ 1614.417268]  [<ffffffff812051f9>] SyS_ioctl+0x79/0x90
[ 1614.417270]  [<ffffffff8167126e>] entry_SYSCALL_64_fastpath+0x12/0x71
[ 1614.417271] vmwrite error: reg 6c04 value 1427e0 (err 1320705)
[ 1614.417272] CPU: 1 PID: 15701 Comm: qemu-system-x86 Not tainted 4.1.0+ #7
[ 1614.417273] Hardware name: LENOVO 2356BG6/2356BG6, BIOS G7ET94WW (2.54 ) 04/30/2013
[ 1614.417273]  0000000000000000 000000006138f41b ffff880007d1fc38 ffffffff8166ab0d
[ 1614.417275]  0000000000000000 00000000001427e0 ffff880007d1fc48 ffffffffa082121a
[ 1614.417276]  ffff880007d1fc58 ffffffffa082123f ffff880007d1fcd8 ffffffffa082c286
[ 1614.417277] Call Trace:
[ 1614.417279]  [<ffffffff8166ab0d>] dump_stack+0x45/0x57
[ 1614.417281]  [<ffffffffa082121a>] vmwrite_error+0x2a/0x30 [kvm_intel]
[ 1614.417284]  [<ffffffffa082123f>] vmcs_writel+0x1f/0x30 [kvm_intel]
[ 1614.417286]  [<ffffffffa082c286>] vmx_vcpu_run+0x566/0x700 [kvm_intel]
[ 1614.417292]  [<ffffffffa07a2943>] ? kvm_set_shared_msr+0x83/0x90 [kvm]
[ 1614.417298]  [<ffffffffa07ac862>] vcpu_enter_guest+0x7e2/0xdb0 [kvm]
[ 1614.417304]  [<ffffffffa07af7a0>] ? x86_emulate_instruction+0x590/0x740 [kvm]
[ 1614.417305]  [<ffffffff810863b1>] ? __set_task_blocked+0x41/0xa0
[ 1614.417311]  [<ffffffffa07b33e5>] kvm_arch_vcpu_ioctl_run+0x2f5/0x420 [kvm]
[ 1614.417316]  [<ffffffffa079b81e>] kvm_vcpu_ioctl+0x33e/0x600 [kvm]
[ 1614.417318]  [<ffffffff81204fa4>] do_vfs_ioctl+0x2c4/0x4a0
[ 1614.417320]  [<ffffffff8129e05d>] ? selinux_file_ioctl+0x4d/0xc0
[ 1614.417321]  [<ffffffff812051f9>] SyS_ioctl+0x79/0x90
[ 1614.417323]  [<ffffffff8167126e>] entry_SYSCALL_64_fastpath+0x12/0x71
Comment 1 Bandan Das 2015-06-29 19:30:49 UTC
(Reposting this since Bugzilla refuses to post with an unregistered email id)

Can you please provide a little bit more information ?
When does the write error happen and what guest/host are you running ?
If it's a regression, would it be possible for you to bisect it ?
Is bug 100661 related to the same hardware ?
Comment 2 Lidong Chen 2015-06-30 00:23:34 UTC
When does the write error happen and what guest/host are you running ?
this error happen when the guest os is booting.
the guest os kernel verison is also 4.1.0+.

If it's a regression, would it be possible for you to bisect it ?
yes,the old kernel version didn't have the bug. so i will try to find out which patch cause this error.

Is bug 100661 related to the same hardware ?
yes.
Comment 3 Andrey Smetanin 2015-07-03 12:24:46 UTC
Created attachment 181741 [details]
another one dmesg

I have the encountered the same bug, guest OS - Windows 2012R2, the guest just after start goes into paused state. The attached dmesg dump contains guest/vms state. The kernel is linux (https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git) with top commit 9bdc771f2c29a11920f477fba05a58e23ee42554
Merge: 7df9ab8 ea7d521
Author: Linus Torvalds <torvalds@linux-foundation.org>
Date:   Thu Jul 2 17:11:28 2015 -0700
Comment 4 Andrey Smetanin 2015-07-03 17:01:42 UTC
Created attachment 181781 [details]
With this patch(commit revert) the bug disappears

Added patch - revert of commit 1cde2930e15473cb4dd7e5a07d83e605a969bd6e. I had tested twice - with revert bug disappears.
Comment 5 cebbert.lkml 2015-08-31 16:40:39 UTC
Fixed in 4.2-rc1 by:

commit 2ecd9d29abb171d6e97a4f3eb29d7456a11401b7
Author: Peter Zijlstra <peterz@infradead.org>
Date:   Fri Jul 3 18:53:58 2015 +0200

    sched, preempt_notifier: separate notifier registration from static_key inc/dec


But this patch was not submitted for -stable.
Comment 6 Paolo Bonzini 2015-09-01 17:06:26 UTC
The faulty patch, 1cde2930e15473cb4dd7e5a07d83e605a969bd6e, was never in a stable release.

Note You need to log in before you can comment on or make changes to this bug.