I had a similar problem where my PDFView would crash on selecting text or other gestures like swiping. Turns out that for some reason it had to do with setting the creationDateAttribute on the documentAttributes of the view's PDFDocument was causing the crash. I don't know how this is related to the problem. Limiting the documents metadata to just some essential information (no creationDateAttribute) did the trick for me.

I had a Sharelink as a ToolbarItem. Tapping wouldn't work. I managed to solve the issue. The presenting View was in fact a .fullscreenCover. Changing the presenting View to a view from a NavigationStack (called by a NavigationLink) did the trick for me.