Thank you MtStefa for the update. I think there is some kind of race condition here, it works sometimes somehow not always. Very wonky. It sometimes randomly keeps asking both the phone and the mac to trust and keeps giving this error on the finder window: Trust Request Error (-402,653,181)

Also posted here: https://discussions.apple.com/thread/256176825 not sure where is the right place