You should install miniforge, tensorflow-deps, TensorFlow-macos and TensorFlow-metal. The tensorflow-deps version should match TensorFlow-macos.

I'm having the same issue, and, sometimes my training just suddenly stops in a random epoch. So now, in order to work, I have to use the parameter with tf.device('cpu:0'), to force CPU use instead of GPU. The worse part is that apple seems like it don't care about fixing that stuffs.