I tried revoking certificates and removing profiles. That did not seem to work. Not sure it mattered since I was using Automatically manage signing. I made sure the capability for Sign-in with apple was on Release, Debug etc. In the end, I changed my build setting in Unity from Run in XCode as Release to Run in XCode as Debug and it worked. Doesn't make much sense, but it is working. Maybe it was some combination fo the above.