Actually, it seems clear that this happens because 1 GB of VRAM and 3 GB of GTT are full with buffer objects. Unless this keeps happening even immediately after closing applications / logging out and back in / restarting X, this looks like a userspace issue (could be a leak somewhere).