The other possibility is that we are doing something wrong with the audio clock recovery, but that's usually directly controlled by the hw.