No need to remove certificates. Just regenerate the provisioning.
https://github.com/fastlane/fastlane/issues/20164#issuecomment-1097495005
Hope this helps.
Topic:
App Store Distribution & Marketing
SubTopic:
App Store Connect
Tags: