Same issue around here and in all of our thousand of customers which use Monterey with Outlook Mac and Exchange OnPrem. There is no way to solve this without a patch or to Monterey or to Outlook... But for now the change was in Mac OS side... It was working before!