just adding it here if it helps someone in future, try regenerating the app specific password, the first app specific password i generated never worked for some reason, but when i regenerated a new one it worked immediately (spent quite some time dealing with this bs, thanks apple)