I followed several guides removing Xcode folders and files from the filesystem and then the third or fourth time I was able to downgrade. Unfortunately, I am not sure about the list of files/folders to delete.