Doing this still causes the save behaviour to be triggered with Cmd + S and File > Save is still a menu option, thanks for the suggestion though

Cmd + S will still attempt the save even if the menu is removed. I did something similar and threw an error when save was attempted, but this seems like it should be done in a better way