I think you misunderstood. I am in fact successfully using a RCP3 shader graph to read the frames from my VNC feed and separate them into right and left eye. The issue is that I can't do something like build a web browser (or better yet safari extension) that has similar capabilities because the browser window needs to be a RCP3 surface that I am applying a material to. It's like watching a movie of an app instead of the actual app and so you can't interact with it
Topic:
Reality Composer Pro
SubTopic:
RealityKit & Reality Composer Pro Q&A