SOLVED: downgraded Xcode to 12.3, now it is working fine. It's just a workaround. Hopefully we will get a permanent solution.

m1 Mac mini has Xcode 12.5 Mac mini late 2014 has Xcode 12.3