It looks like this issue is finally fixed in Xcode 26.0. An incremental xcodebuild (second run) in an empty project now takes about 1 second on my machine without any modifications to network rules.
Topic:
Developer Tools & Services
SubTopic:
Xcode
Tags: