I found that connecting to a display of 1080p with the Retina display turned off fixes all lag issues of the Mac except the notification centre lag I would say it is an issue where Big Sur doesn't like the Retina display that much.