Moving the view to a @ViewBuilder function fixed it for me as well, sadly I wasn't able to reproduce the issue in a clean project.
Topic:
UI Frameworks
SubTopic:
SwiftUI
Tags: