Updating to 13.4.1 did nothing to address this bug. I'd have to imagine that Apple Developers are experiencing this themselves.

Doing more research, I found this in my log file when putting the display to sleep, getting repeated errors. error 18:03:48.968770-0500 com.apple.AmbientDisplayAgent [ERROR] - Unable to create and lookup port "com.apple.CoreDisplay.master" => 1102 0 0x18d79fb58 CoreDisplay::Mach::Port::Port(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, CoreDisplay::Mach::Port::PortLookup) + 392 1 0x18d75ff5c CoreDisplay_Display_SetAutoBrightnessIsEnabled + 168 2 0x104012a44 setCompensationState + 60 3 0x104013ff4 main + 4852 4 0x18b91fe74 _xpc_connection_call_event_handler + 152 5 0x18b91e8f4 _xpc_connection_mach_event + 1376 6 0x18ba2c4c0 _dispatch_client_callout4 + 20 7 0x18ba48ed8 _dispatch_mach_msg_invoke + 468 8 0x18ba33960 _dispatch_lane_serial_drain + 372 9 0x18ba49c24 _dispatch_mach_invoke + 448 10 0x18ba3f244 _dispatch_workloop_worker_thread + 648 11 0x18bbd8074 _pthread_wqthread + 288 12 0x18bbd6d94 start_wqthread + 8