VAAPI worsens performance

It seems in several applications Vaapi significantly worsens performance.
CPU-usage:
VLC without VAAPI: ~40%
VLC with VAAPI: ~90%
MPV however seems to work fine:
–vo=opengl --hwdec=vaapi: ~8%
–vo=vaapi --hwdec=vaapi: ~8%
–vo=vaapi --hwdec=vaapi-copy: ~16%
–vo=opengl --hwdec=vaapi: ~50%