I have 16 GB memory, and the same issue. On my new MacBook Pro M1 (with 32 GB memory) I did not get the issue up to now.