This is driving me insane as well. I only want inbox notifications on my primary calendar, but I could also do without them entirely. My company is constantly sending out invitations at all hours of the day/night and that badge triggers my OCD.