I have the same issue with MacBook Pro 16 M1. When I'd faced with the issue for a first time I am also as other guys thought it is due to bad quality of audio. Currently I have only one solution is to use Bluetooth Headset. It is shame on Apple for not fixing this issue for laptop that is not so cheep

Is there any update ? I have faced with the same issue that even example code from https://developer.apple.com/metal/tensorflow-plugin/ runs 4x slower than on CPU !!