This seems to have significantly improved as of macOS Sonoma 14.3 Beta (23D5033f).