Not working.

This issue is infuriating. You're 100% correct that this is the source of the problem, the VPN isn't to blame. For reference, using my iOS 16.6 device, with the Xcode 15 (b7), I am able to uncheck that box and run with VPN on. On iOS 17 device, the box is stuck being checked.