I am experiencing the same issue on my MacBook Pro M1. I was restarting my computer to fix the scroll issue, but I've since realized I can just restart my Magic Mouse with the on/off switch.