Whenever I try to connect to a server hosted on my friend's network, the request times out. This also happens when he tries to connect to a server hosted on my network. Nobody else who tries to connect to my network or his network has any problems. This happens whenever either of us host a game server or VPN.
So far the only thing that I can think of that is different between him and my other friends is that both he and I have Comcast, where my friends use other ISPs. As far as I can tell, neither of us are refusing connections or have the other person blacklisted or anything like that.
What might be causing this problem, and how could I fix it?