Yes, I do confirm this observation on my M1 Max. Training TF 2.0 on Nvidia cards is WAY MUCH better than Apple Silicon GPU regarding the accuracy of results. I suspect that it is due to Apple Neural Engine which isn't yet optimized for TF processing.