Interactive Surfaces

Question

Created 1w

Replies 2

Boosts 0

Participants 2

This post is from the WWDC26 RealityKit & Reality Composer Pro Q&A.

I have been building a visionOS app that converts anaglyphs and SBS to 3D experiences, and my current approach has been hamstrung by my dependency on a shader graph which separates imagery into right and left eye. It works very well, but ultimately is just a material. The way I have implemented this so far is with VNC to show a 3d Blender window and browser experiences. Ideally, I'd be able to have interactivity in both that didn't depend on an attached computer. Is there any way to accomplish that?

Answer 1

Vision Pro Engineer OP

Apple

5d

Have you tried building a shader graph in RCP3 and then using that to decipher the images? I would expect you could translate your Blender shader into an RCP3 shader.

Answer 2

aharriscrowne OP

3d

I think you misunderstood. I am in fact successfully using a RCP3 shader graph to read the frames from my VNC feed and separate them into right and left eye. The issue is that I can't do something like build a web browser (or better yet safari extension) that has similar capabilities because the browser window needs to be a RCP3 surface that I am applying a material to. It's like watching a movie of an app instead of the actual app and so you can't interact with it