I have found that if you keep the sound preferences pane open (but hidden is fine) the issues go away. If you switch to a different systems preference pane, or close it, they come back.