I figured out the what the issue is. I have enabled "Button Shapes" in Settings>Accessibility>Display & Text Size. This will enforce the shadows around buttons that cause this problem.