Apparently some good news after a few years in the making: some people are reporting this is finally fixed in macOS Sonoma. https://www.audiosciencereview.com/forum/index.php?threads/audio-stutters-with-usb-dacs-on-macbook-m1-pro.42001/page-15#post-1652819