This is not related to cpufreq. I've fixed my governor to the highest frequency and still experience these massive lags.