VLC probably doesn't use the hardware decoders. Linux video acceleration is a mess, and without the exact correct versions of every component, it doesn't work and will fall back to slow software.

Hardware decoders tend to be picky about the exact video format. VLC wants to work with anything, which also makes it not a good idea to use the hardware decoders.

Even Chrome on Linux doesn't use hardware acceleration on any GPU for video.