Yes it is possible. Treat bar codes as image anchors. Load the identifiable images based on location. Affix your 3D models to entities attached to the detected image anchors. https://developer.apple.com/documentation/arkit/arkit_in_ios/content_anchors/detecting_images_in_an_ar_experience?cmdf=arkit%20image%20anchor

I wish CloudKit had jobs, too, but alas… One idea is to have clients do the job. Check if there's a recent aggregate record, and if not, create one. Sure, you might have several clients doing similar work at similar times, but you won't have the cost of running a server somewhere.

ARKit, go!

in UIViewRepresentable.updateUIView, you shouldn't be reloading the scene from disk on each update. that seems expensive if that doesn't make an impact, I'm not familiar with using SceneKit with SwiftUI, so not sure how UIViewRepresentable.updateUIView works with/against a typical SceneRenderDelegate.updateAtTime implementation. fwiw.

Use AVFoundation to encode a video from each ARFrame.capturedImage. You'll need AVAssetWriter, AVAssetWriterInput, AVAssetWriterInputPixelBufferAdaptor.

file a feature request in Feedback Assistant

in visionOS v1.0, full body tracking is not exposed to third party developers. Hand tracking can be requested. https://developer.apple.com/documentation/arkit/handtrackingprovider/?cmdf=visionOS%20hand%20tracking

there is a limit for all query ops, and there is support for cursors (a form of batching) https://developer.apple.com/documentation/cloudkit/ckqueryoperation/1514975-cursor?cmdf=cloudkit%20cursor

My understanding is, No, using compositor services requires full immersion

I would love to see some sample code showing how you're generating a dynamic texture with DrawableQueue! That said, I can see from the image that your sending UsdUVTexture.RGBA, which has 4 components, to UnlitSurface.Color, which only takes in 3 components. You need to split the RGBA out, then pass the first three into Color, and the last into Opacity.

I've submitted feedback #FB13428615

use an App Group to share across you app and extension

curious why you want to roll your own, rather than use Apple's implementation?

You must specify the bundle ID as the container identifier when instantiating your CKContainer.

Yes. surface geometry can be retrieved textures on geometries can be drawn/animated hand position can be retrieved its all possible