I didn't solve this because I no longer work on that project. They've also since replaced my library with WebRTC. This issue may or may not be present in modern versions of macOS — I haven't built anything related to CoreAudio since 2019.