I have a similar use-case. I have my app and test runner installed on the device. I use "UseDestinationArtifacts" to simply execute the tests on my device cloud. With ios 17 beta versions, am facing the same issue.