I have also been struggling with this exact issue and feel that it should be a simple solution I am missing. Do you have any updates?

I am having the same issue in my own project and was hoping you had any positive updates?