What seems to have helped was closing the project in Xcode 15, Opening in Xcode 14, building there and then switching back to Xcode 15. Now I seem to be able to build and run from Xcode 15 to my iOS 17 Beta device!