Revisited as .highPriorityGesture mentioned above wasn't perfect. The approach here: https://www.hackingwithswift.com/forums/swiftui/a-guide-to-delaying-gestures-in-scrollview/6005 solves the problem.

Same worked for me in Xcode 15.4. Thanks.