Make sure nothing else (e.g. gdm in Wayland mode) is using the GPU you're trying to unbind either. Something like sudo lsof /dev/dri/* shows which process is using which GPU device(s).