3.0 worked fine, 3.1-rc9 worked fine, I think -rc10 too. 3.1 release hangs in random places while using X.
Do you have VT-d enabled in the BIOS?
Disabled VT-d in BIOS and 3.2-rc3 has been running stable since then. SO it seems to be the same problem.