Suprisingly, enabling GALLIUM_HUD="GPU-load;fps;cpu" workarounds this too and lowers the delay to HUD update step.