This is resolved now. My main Apple account was logged in with another ID, so I just logged out which and logged with my sandbox test account. After that, I was able to add test cards to the wallet successfully.