This could happen if your annotation items are ObservableObjects, and they are getting updated when your map is being rendered. You could try creating simple Structs to represent your annotations and convert your ObservableObject annotations to the Structs to pass into your Map(). This resolved the issue for me.