Well first of all try to avoid the VDPAU wrapper for VA-API or the VA-API backend for VDPAU. Those transition layers seem to have the tendency to add quite a bit of instability. If you can try to use the native VDPAU implementation. We only did the VA-API implementation as a drop in replacement when the user has no other choice than to use VA-API. So can you reproduce the issues with VDPAU as well, or is that limited to VA-API only?