You're right! I didn't even notice this, but it's also happening in our app, and I just made a clean sample project that also has this problem. It's obviously a bug somewhere in SwiftUI, of which there are many. :(
You should file a bug report, and I'll do the same.
Topic:
UI Frameworks
SubTopic:
SwiftUI
Tags: