Not OP but running into similar issue. Can we expect a way to render Swift UI components as textures in the future by any chance? Even if without interactions given the geometry mesh can complicate things

Not vision pro engineer but curious what your shader graph looks like maybe i can help, I imagine separate controls for the x-axis vs y-axis should solve it.

Not OP but is it possible to apply this affect to a video? I was able to achieve the same effect using an image resource but not sure how I go about a video.