Post

Replies

Boosts

Views

Activity

Comment on Reality Converter - Unlit Material
Hi Daniel, yep that's a valid usecase. I'm afraid though there is no way to export your scene from RealityKit into a .reality file – at least I none that I know of. This would probably be a good candidate to file a feedback radar for. What should maybe work is editing and saving your USDZ file (if you have one) in the Xcode scene editor which should support Unlit Materials via the emissive channel.
Nov ’21
Comment on How can i add a UIView on the material of the ModelEntity?
Hi, I fear adding interactions could prove troublesome. Even with the SceneKit option afaik you don't get support for touch gestures etc as it just renders the visual representation of the underlying CALayer. Potentially you could try rerouting touch events from your ARView to the UIView you want to display. Beforehand you could do a hittest and see if the geometry for the custom view intersects with the users touch. To reroute touch events you could like into the UIKit hitTest API: https://khanlou.com/2018/09/hacking-hit-tests/
Topic: Graphics & Games SubTopic: RealityKit Tags:
Nov ’21
Comment on Create MTLLibrary from raw String for use within RealityKit
Hi, sorry just saw that. Apparently the threads do not get bumped up for comment replies. Regarding the use case: Frankly speaking it's kind of both. The shareable/downloadable custom materials use case is the more 'urgent' but I was also playing with the idea of creating a dedicated shader editor app – for custom materials as well as post processing effects. Related to that: is there a way to 'preheat' custom materials to avoid initial delays when adding them to entities in a scene? Something like SceneKits prepare method (https://developer.apple.com/documentation/scenekit/scnscenerenderer/1523375-prepare).
Topic: Graphics & Games SubTopic: General Tags:
Nov ’21
Comment on RealityKit - MeshAnchor with Custom Material problems
Can you give some info about what can lead to the console warning »ARSessionDelegate is retaining X ARFrames. This can lead to future camera frames being dropped»? Because I can't remember seeing that warning before iOS 15 and now even with simple projects I've noticed it quite a couple of times but haven't really found out the root cause of it yet.
Topic: Spatial Computing SubTopic: ARKit Tags:
Nov ’21
Comment on Create MTLLibrary from raw String for use within RealityKit
Oh btw: if I would want to create an on-device shader editor for geometry modifiers or surface shaders, using the above method is currently the only option – correct? Or is there a way to take some metal files/source strings, compile them and write everything to a file? Is the newish MTLDynamicLibrary API (https://developer.apple.com/documentation/metal/mtldynamiclibrary/3553982-serialize) suitable for this?
Topic: Graphics & Games SubTopic: General Tags:
Nov ’21
Comment on Create MTLLibrary from raw String for use within RealityKit
Hi, thanks for your reply! I figured that might be the issue but had hoped there would be another way. That being said, I've tried to inline the header file contents and it actually works really well. As I can prepare the shaders before showing the content anyway, hitches shouldn't be too much of an issue. I'll file a feature request tomorrow and post the number here, thanks!
Topic: Graphics & Games SubTopic: General Tags:
Nov ’21