This is resolved.
In case anybody is googling this issue here are the details.
If I added the keys to the extension and the app file, it complained the app file was invalid. If I removed them from the app file, it complained they were missing.
The correct solution is to have the keys in the Info.plist for the EXTENSION, then create a new plist for the [MyApp] target and add the keys to that also.
Topic:
App Store Distribution & Marketing
SubTopic:
App Store Connect
Tags: