https://bugzilla.kernel.org/show_bug.cgi?id=206987
--- Comment #34 from Petteri Aimonen (jpa@kernelbug.mail.kapsi.fi) --- @krakopo Can you apply the debug info patch from here? https://bugzilla.kernel.org/attachment.cgi?id=289421&action=diff
What kernel are you running inside the KVM virtual machine? I wonder if the virtual machine has the MXCSR problem, perhaps it could be leaking to the host somehow.