I have this same problem.

When I tried this with a simulator running iOS 15.0, I could not drag from my Downloads folder onto the Simulator Files app. That failed with "you don't have permission" When I moved the file to my Documents folder, I was able to drag it into the Files app.