Apple seems to have fixed it. The build worked today without any change on my side.

Still happening with macOS 15/iOS 18, filed another feedback under FB13993465, hope it gets finally fixed with the new major releas