I'm having the same issue. My M1 MacBook pro will sometimes take 8 hours to update xcode. Very frustrating.