FWIW, I don't think unbinding is supposed to be possible while Xorg (or anything else) is using the GPU. Sounds like there's something missing somewhere to prevent that.