For me, it was the knockoff connector I was using that was connected to another cable as well. Once I bought an Apple made usbc to usbc, no issues.

This chat helped me figure out my issue as well with a slightly different flavor. Newer to Swift so probably a newbie mistake, but it took hours to realize I had a popback issue because I had a Navigation Stack loading another view that also had another Navigation Stack. Changed the child view to a Navigation View and it FINALLY works.