I'm seeing the same thing. It seems to be worse when the underlying screen is more complicated. The SwiftUI body isn't being re-rendered but I still get this stutter. Were you able to improve this behaviour @j0nas00?

This seems a lot better on iOS 18.1 - possibly a fix went in for this. I am yet to reproduce it.

Is there any update on this? I'm seeing it too (pretty consistently)

I have filed a bug report under FB15529579