Apple got back to me suggesting to try the latest iOS 16.1 beta, initial testing on one device seems to show it is fixed in that version, I still need to check the other device we were working with

I submitted a bug to Apple, this is quite a serious issue for us.