So I tried with XCode 14 now and it works fine, so the issue is with XCode 15 Beta + iOS 17

I am having the same issue on iOS 17