I have the same problem. Very annoying on a 2 day old 2020 MacBook Pro with Magic Mouse 2.