I've found it by opening up Activity Monitor with the memory tab and Xcode build logs at the same time. Then I just waited for memory spike to see what Xcode was building at that time.