Nvm I figured it out! Apparently my drag gesture was using the local coordinate space when it needed to use the global coordinate space.
Topic:
UI Frameworks
SubTopic:
SwiftUI
Tags: