Still experiencing this problem after upgrading to 12.4 on MacBook Pro 15 and DTK under MacOS 11.2 and on iMac 27" running under Catalina. Turning off "Connect via network" on the MacBook Pro caused Xcode to crash (sigh). Seems like the issue is getting worse.

Xcode 12.3 causes this problem for me. Unpairing devices does not resolve the problem.

I have the same issue. Removing/adding devices does not solve the issue for me.