Mine says it's ejected (it's my time machine disk that is permanently plugged in) but actually seems to go on working. I would eject it properly and then set it up again, but I don't really seem to need to. I'm on a 2021 iMac running Monterey, so it's still happening.