Solved! Tried all the mentioned solutions but none worked. In the end I plugged the Homepod into my Mac and reset it (search for "Reset Homepod with computer"). This ensures the latest software is installed as well, which seemed to be the issue.