Thank you Eskimo. I suspect it is a notarization server issue at that time? I got it working today. If there is something wrong, I will get you updated.

using following to build protobuf 3.20 fat library, passing the make check CXXFLAGS="-arch x86_64 -arch arm64 -mmacosx-version-min=11.0 -std=c++11"