This is what worked for me when removing ~/Library/Caches/org.swift.swiftpm/ and logging out and back into GitHub failed. Thanks!

This was exactly my issue... thanks!