https://bugzilla.kernel.org/show_bug.cgi?id=91861 seems to be related, however this issue still happens with kernel 4.9