It seems not to be related to drive size. I have a MacBook Pro M1 and Sequoia is on a 2TB external drive, and I have the same issue.
Topic:
Developer Tools & Services
SubTopic:
Xcode