Bah, nevermind. Either my bug is not related or it gets fixed the same way. Updating kernel from 4.11.6 to 4.12.10 seems to have solved all the weird performance issues.