Go to your app on the Apple Connect Website
Under Pricing and Availability you will find a checkbox "Apple Silicon Mac Availability - Make this app available"
If you uncheck this it should stop giving you the apple silicon warnings
Topic:
App & System Services
SubTopic:
Hardware
Tags: