You don't even have to remove and re-add. Right click on the repo providers under "Source Control Accounts" and then select "Refresh Account". This was enough to clear the issue.