At the end panhuyzen was right. We only had to remove the unneeded property on the entitlements file. Thanks!

Thanks Jason. About your questions: The three machines on my desk are using the same Game Center account, but other people on the team using 12.4 are having the same issue, while using their own accounts. Feedback added as FB10762124