Had the exact same issue for In House (Enterprise) signed apps that was built using Xcode 12.4 on Appcenter / GitHub actions. I only updated the builds to use Xcode 12.5.1 and the apps are running now on iOS 15. Did not need to renew the provisioning profiles.