You may try to use vdpau decoding with opengl video out (if it not this case),
for me it much more stable than using vdpau decoding with vdpau video out (at
least with rv730 agp card).