I have the same problem. I have spent 20+ hours trying to get it to only use the watch and the only way I have found so far is to turn off bluetooth on the phone.