I got same issue with the latest iPadOS dev beta. No change even connection reset.

The latest iPadOS15.5 dev beta FINALLY solved this Apple Pencil 2 with Magic Keyboard issue. Thanks Apple!