[RFC PATCH 4/5] fbdev: Fix some race conditions between fbmem and sysfb