Post

Replies

Boosts

Views

Activity

Reply to How can I pinch to open a menu in VisionOS simulator?
I don’t see code in your recent post that invokes the open window command. However, without an entity to receive the tap, it may not be possible to do what you want. An empty Immersive View doesn’t have anything to receive the tap. You may need to use the scene reconstruction provider to generate meshes of the world so those meshes can receive the taps. This is not available in the simulator at the moment.
Topic: UI Frameworks SubTopic: SwiftUI Tags:
Sep ’23
Reply to Can't center entity on AnchorEntity(.plane)
I felt like this should be obvious because it's such an important use case for dropping RealityKit scenes into the world without user interaction, but I tried a few things with translation that failed. For some reason what worked for me was calling box.setPosition.... relative to nil. I'm not sure why it works given that the documentation says "nil" means "world space", when it appears to behave as if nil means "parent space" in this case? class Model: ObservableObject { var wall: AnchorEntity? var child: ModelEntity? } struct ImmersiveView: View { @StateObject var model = Model() var body: some View { RealityView { content in let wall = AnchorEntity(.plane(.vertical, classification: .wall, minimumBounds: [2.0, 1.5]), trackingMode: .continuous) model.wall = wall let mesh = MeshResource.generateBox(size: 0.3) let box = ModelEntity(mesh: mesh, materials: [SimpleMaterial(color: .green, isMetallic: false)]) model.child = box wall.addChild(box, preservingWorldTransform: false) content.add(wall) box.setPosition([0, 0, 0], relativeTo: wall) } update: { content in if let box = model.child, let wall = model.wall { // box.setPosition([0, 0, 0], relativeTo: wall) // <---- DOES NOT WORK box.setPosition([0, 0, 0], relativeTo: nil) // <---- DOES WORK even though nil means "world space"???? } } } }
Topic: Graphics & Games SubTopic: RealityKit Tags:
Sep ’23
Reply to Dragging coordinates issue in VisionOS
You're probably going through a moment of "What in the world? That wasn't mentioned anywhere!". And yeah, a lot of the demonstrations use an AnchorEntity of type "Plane" to insert a RealityComposer scene into the RealityView at a spot in the world that meets the size criteria, or just do "Content.addEntity" when the realityView loads for an Immersive Scene. It's important to note these are not "world tracked" entities, and will not enable accurate location3D values for interactions. We can use "rotate" and "magnify" in these situations as those gesture change relative to their initial value. Tap gestures can even be used as a sort of tap-boolean, but the location of the tap is not reliable. You're also probably asking "How can I make anything interactive enough to feel immersive this way???" And yeah, I don't have a clue. Maybe if we pay $4000 or get lucky with a developer kit we can figure it out. We can't ask anyone with a developer kit because they're banned from telling us.
Topic: Graphics & Games SubTopic: RealityKit Tags:
Sep ’23
Reply to Dragging coordinates issue in VisionOS
Please file a feedback on this to increase pressure to get it added. I've done so on an adjacent issue related to non-"world targeting" entities. The lack of the PlaneDetectionProvider and SceneReconstructionProvider support in the simulator is felt more and more as we run into these issues.
Topic: Graphics & Games SubTopic: RealityKit Tags:
Sep ’23
Reply to Is it possible to place content on the plane detected in the visionOS simulator?
I am not seeing any changes in VisionOS Beta3 with respect to placing content where a user taps on a plane. PlaneDetectors are still not available World Tracking Provider still doesn't return after asking it to track an anchor The Scene Reconstruction provider is still missing. Taps on a scene AnchorEntity of type plane still report inaccurate positions Taps on a plane placed at a world AnchorEntity still report inaccurate positions Feedbacks filed with no response: FB13034747 FB13034803 FB12952565 FB12639395 Maybe beta 4?
Topic: App & System Services SubTopic: Core OS Tags:
Aug ’23
Reply to Vision Pro: UX: how to close an immersive view?
Control center also offers a way to exit immersive scenes
Topic: App & System Services SubTopic: Core OS Tags:
Replies
Boosts
Views
Activity
Oct ’23
Reply to PlaneDetection, ImageTracking and Scene Reconstruction support on VisionOS Simulator NOT WORKING
My feedback says no recent similar reports. FB12639395.
Topic: Spatial Computing SubTopic: General Tags:
Replies
Boosts
Views
Activity
Oct ’23
Reply to PlaneDetection, ImageTracking and Scene Reconstruction support on VisionOS Simulator NOT WORKING
Still not working in beta 4. Still haven't heard back on devkit application.
Topic: Spatial Computing SubTopic: General Tags:
Replies
Boosts
Views
Activity
Oct ’23
Reply to PlaneDetection, ImageTracking and Scene Reconstruction support on VisionOS Simulator NOT WORKING
At the moment there is no workaround other than receive a dev-kit or purchase a device when it releases. I am in the same boat as you.
Topic: Spatial Computing SubTopic: General Tags:
Replies
Boosts
Views
Activity
Sep ’23
Reply to How can I pinch to open a menu in VisionOS simulator?
I don’t see code in your recent post that invokes the open window command. However, without an entity to receive the tap, it may not be possible to do what you want. An empty Immersive View doesn’t have anything to receive the tap. You may need to use the scene reconstruction provider to generate meshes of the world so those meshes can receive the taps. This is not available in the simulator at the moment.
Topic: UI Frameworks SubTopic: SwiftUI Tags:
Replies
Boosts
Views
Activity
Sep ’23
Reply to QR / Image marker recognition with Vision Pro
You can construct an AnchorEntity targeting an image in the app's bundle: https://developer.apple.com/documentation/realitykit/anchorentity/init(_:trackingmode:)
Topic: Programming Languages SubTopic: Swift Tags:
Replies
Boosts
Views
Activity
Sep ’23
Reply to VisionOS Simulator and ARKit Features
Correct, in betas 1-3 of VisionOS ARKit data provides like plane detectors and scene reconstruction do not work. You can make an AnchorEntity of type plane and it will find a surface, though.
Topic: Spatial Computing SubTopic: ARKit Tags:
Replies
Boosts
Views
Activity
Sep ’23
Reply to How to launch a Volume or ImmersiveSpace from UIKit?
ImmersiveSpaces are not possible per Apple reply here: Link
Topic: UI Frameworks SubTopic: UIKit Tags:
Replies
Boosts
Views
Activity
Sep ’23
Reply to Creating an immersive space using UIKit?
Not possible per Apple reply here: Link
Topic: Graphics & Games SubTopic: General Tags:
Replies
Boosts
Views
Activity
Sep ’23
Reply to Creating an immersive space using UIKit?
Not possible per Apple reply here: Link
Topic: Graphics & Games SubTopic: General Tags:
Replies
Boosts
Views
Activity
Sep ’23
Reply to Can't center entity on AnchorEntity(.plane)
I felt like this should be obvious because it's such an important use case for dropping RealityKit scenes into the world without user interaction, but I tried a few things with translation that failed. For some reason what worked for me was calling box.setPosition.... relative to nil. I'm not sure why it works given that the documentation says "nil" means "world space", when it appears to behave as if nil means "parent space" in this case? class Model: ObservableObject { var wall: AnchorEntity? var child: ModelEntity? } struct ImmersiveView: View { @StateObject var model = Model() var body: some View { RealityView { content in let wall = AnchorEntity(.plane(.vertical, classification: .wall, minimumBounds: [2.0, 1.5]), trackingMode: .continuous) model.wall = wall let mesh = MeshResource.generateBox(size: 0.3) let box = ModelEntity(mesh: mesh, materials: [SimpleMaterial(color: .green, isMetallic: false)]) model.child = box wall.addChild(box, preservingWorldTransform: false) content.add(wall) box.setPosition([0, 0, 0], relativeTo: wall) } update: { content in if let box = model.child, let wall = model.wall { // box.setPosition([0, 0, 0], relativeTo: wall) // <---- DOES NOT WORK box.setPosition([0, 0, 0], relativeTo: nil) // <---- DOES WORK even though nil means "world space"???? } } } }
Topic: Graphics & Games SubTopic: RealityKit Tags:
Replies
Boosts
Views
Activity
Sep ’23
Reply to Dragging coordinates issue in VisionOS
You're probably going through a moment of "What in the world? That wasn't mentioned anywhere!". And yeah, a lot of the demonstrations use an AnchorEntity of type "Plane" to insert a RealityComposer scene into the RealityView at a spot in the world that meets the size criteria, or just do "Content.addEntity" when the realityView loads for an Immersive Scene. It's important to note these are not "world tracked" entities, and will not enable accurate location3D values for interactions. We can use "rotate" and "magnify" in these situations as those gesture change relative to their initial value. Tap gestures can even be used as a sort of tap-boolean, but the location of the tap is not reliable. You're also probably asking "How can I make anything interactive enough to feel immersive this way???" And yeah, I don't have a clue. Maybe if we pay $4000 or get lucky with a developer kit we can figure it out. We can't ask anyone with a developer kit because they're banned from telling us.
Topic: Graphics & Games SubTopic: RealityKit Tags:
Replies
Boosts
Views
Activity
Sep ’23
Reply to Dragging coordinates issue in VisionOS
Please file a feedback on this to increase pressure to get it added. I've done so on an adjacent issue related to non-"world targeting" entities. The lack of the PlaneDetectionProvider and SceneReconstructionProvider support in the simulator is felt more and more as we run into these issues.
Topic: Graphics & Games SubTopic: RealityKit Tags:
Replies
Boosts
Views
Activity
Sep ’23
Reply to Is it possible to place content on the plane detected in the visionOS simulator?
I am not seeing any changes in VisionOS Beta3 with respect to placing content where a user taps on a plane. PlaneDetectors are still not available World Tracking Provider still doesn't return after asking it to track an anchor The Scene Reconstruction provider is still missing. Taps on a scene AnchorEntity of type plane still report inaccurate positions Taps on a plane placed at a world AnchorEntity still report inaccurate positions Feedbacks filed with no response: FB13034747 FB13034803 FB12952565 FB12639395 Maybe beta 4?
Topic: App & System Services SubTopic: Core OS Tags:
Replies
Boosts
Views
Activity
Aug ’23
Reply to Is it possible to place content on the plane detected in the visionOS simulator?
Here are some related topics and posts that I've made trying to get this to work as well: https://developer.apple.com/forums/thread/735900 https://developer.apple.com/forums/thread/735558 https://developer.apple.com/forums/thread/735537 https://developer.apple.com/forums/thread/735305
Topic: App & System Services SubTopic: Core OS Tags:
Replies
Boosts
Views
Activity
Aug ’23