Yes, before I post this issue, I remove the first two framework for digging the reason. And I double checked it today. It's really wired. My Xcode's version is 13.4. I will update Xcode to 13.4.1 to check the problem again.

XCFramework is a very good tool. I will use it in the future. But before XCFramework is introduced, the normal framework is combine with x86 and arm64 architecture as I knew. The only problem I encountered is when archive and upload, the framework contains x86 will be rejected. But this can be solved by scripts which rip the x86 part off. Thx for your help!

OK, I will make a bug report.