Update to iOS 14.5.1 fixed this issue for me. Works while on wifi, as well.

Same issue here. On a 12 mini with Ver 14.4.2. Apple music crashing. Tried hard reset of phone, delete and reinstall app. Now updating iOS to 14.5.1. Next step after that will be to switch off wifi. Wish me luck!