The images are loaded as if they were ordinary jpeg, but Nginx rewrites them internally to the webp version. And yes, I use webp on all my sites (including non-wordpress).
You'll have to use the Developer Tools on your browser to inspect the request headers, and check whether the rewrite is occurring or not.