For me it only works after I turn off and on the magic mouse and then go to System Preferences - Mouse - Setup new bluetooth mouse. This pairs again the mouse without the need to restart the Mac