I am facing the same issue. A huge memory leak (20GB+) quickly builds up when fitting a model under default settings. Only when the device is set to CPU does the leak not occur. This, however, is not a permanent solution - the GPUs are an important part of the value proposition of Apple silicon. Please address ASAP!