Yea, exact same problem with me. Scroll and all the gestures stop working if the mouse is left idle for sometime and the only option to remedy this is turning the magic mouse off and then on!