For what it's worth, running Xcode 13.2 beta in Rosetta mode made this stop happening for me (despite it happening when not running in Rosetta mode). It was fun getting an "out of application memory" popup like ten minutes into using this 64GB machine, though.

Did you ever get to the bottom of this? having the same problem with XCode 13, iOS 15