I have had the same issue and thanks to your post I found that any not bordered, and not automatic or default, buttonStyle works correctly (that are: plain and borderless).
Moreover the issue is absent on macOS.
Topic:
UI Frameworks
SubTopic:
SwiftUI
Tags: