I tried setting the physics simulation to both .isolated and .none, both don't work.
I tried setting it on the fingertip anchor entities, also on the boxTopColliision anchor.
To be clear, I did it like
boxTopCollision.anchor?.anchoring.physicsSimulation = .none
Is this the right place to do it.
I also tried the same with the finger tip entities
handTrackingManager.rightIndexFingerTip.anchor?.anchoring.physicsSimulation = .none
I tried it together and one at a time still no avail.