I’m still struggling with the same confusion and haven’t found a clear criterion for making a decision.

I solved this problem by simply upgrading visionos to 1.2 beta3, before that I was visionOS 1.1 version