Not OP but is it possible to apply this affect to a video? I was able to achieve the same effect using an image resource but not sure how I go about a video.

Not vision pro engineer but curious what your shader graph looks like maybe i can help, I imagine separate controls for the x-axis vs y-axis should solve it.

Not OP but running into similar issue. Can we expect a way to render Swift UI components as textures in the future by any chance? Even if without interactions given the geometry mesh can complicate things