Simply switching WiFi on/off helps to resolve this strange bug.

Swapping to 2.4 GHz helped me as Apple TV kept showing the Pair button after entering the pairing code.

All three developers are working hard to get it shipped. This is why nobody can straighten your surprise!