No , even on 12.4 beta2 the problem still exist.

I turn off the bluetooth ,the error does not happen again.Maybe you can try.🤔 I think it's related to bluetooth .Apple changes bluetooth working mode, so it can work for universal control.

I can't tolerate this problem so I downgrade to Big Sur now my Mac works fine.🙂