I was able to solve the issue by changing which network on the router I was using for both of my devices. I was facing the problem when I was using a 2.4Ghz network, but it went quite smooth when I changed to the 5GHz network.