Hello, I would like to inquire about recommendations regarding the performance overhead of VDB simulation on the M5 Vision Pro. Additionally, I would like suggestions for the best implementation for simulating rivers, waterfalls, snowflakes, and flames.
RealityKit itself does not support VDB volume rendering. As such, on Vision Pro, you would have to use your own renderer or directly create the appropriate RealityKit mesh and shader effects to represent your volume.
Volumes can be quite expensive to render, and there's no one size fits all solution for different types of volumetric data.
If you were planning to use RealityKit, you would have to either pre-process your VDB files in an area where you have access to VDB or bundle OpenVDB within your app and process them live. You'd have to then create a mesh representation of the volume and use that to drive a LowLevelMesh (https://developer.apple.com/documentation/RealityKit/LowLevelMesh) in RealityKit.
You could also apply some amount of effects via a shader on top of this mesh to provide a more volumetric feel.
