I am having a similar problem. It seems that the Embedding layer is causing some troubles to Tensorflow on M1. I updated the libraries to the version mentioned in this thread, but it didn't work out for me. I detailed my problem here: https://developer.apple.com/forums/thread/700727

Updating tensorflow-macos to 2.8 and tensorflow-metal to 0.4 solved the problem

I'm having the same problem. I don't know how to interpret it, did you find any solutions?