It seems, those mini freezes started to happen after the my last pull from drm-next-3.19 (see bug #86832)