4 years and no solution to this? Wow.
OK, I've found it:
Log in to the AppStore Connect
Open Pricing and Availability
Scroll to iPhone and iPad Apps on Apple Silicon Macs section
Uncheck "Make this app available"
Click "Save"
Topic:
App Store Distribution & Marketing
SubTopic:
App Store Connect
Tags: