I'm experiencing the same issue due to compilation fail on RealityKitContent.rkassets with "realitytool requires Metal for this operation and it is not available in this build environment". I'm not using ImageBasedLightComponent. Seems like migrating From RCP is the only way to solve this issue

Especially big problem for Apple Vision Pro game development

Same issue, no solution