I also had the same problem with the M5 pro running a 4K 160hz display. I did the same troubleshooting steps to no avail. It could most likely be as software bug, for now I guess we have to wait for newer updates of macOS to resolve this issue.
Topic:
Graphics & Games
SubTopic:
Metal