thank you, i just submitted a feedback regarding this issue

Boosting this, but have you found a way to achieve this?

Yes, the environment I am entering is a usda file, in which I added Video Dock using Reality Composer Pro. and I used immersiveEnvironmentPicker modifier on my AVPlayerView, a simple wrapper for AVPlayerViewController. alternatively, is there any way I can enable video reflection / diffusion on VideoMaterial?

solved. swizzle's channel is by default, set to rrr, changing it to rgb fixed it

adding images used

repo for this issue: https://github.com/ckse93/VisionOSGeometryModifier once you have it run on the device, tap on "no14 wave"

I found out the issue. The input depth map image for GeometryModifier's Model Position Offset needs be the same dimensions as the input image.

Bit exaggerated, but this is what I envisioned