How do I get to the bottom of network latency and bandwidth issues

Question

I recently moved two blocks south. That move moved me from Comcast to Broadstripe (high-speed internet cable providers). Comcast was pretty good. Broadstripe sucks. I called them on the phone, and they basically brushed me off (politely). I want to come to them with some numbers, so I can say more than just "it's really slow".

I still have access to my old Comcast service, so I can run the tests using both providers.

Here's what I'm seeing with my new Broadstripe service:

1. When I browse to most sites, there is a long delay (5-10 seconds) before the page starts loading in my browser
2. The speed test tell me I have 12 megs down (bullshit)
3. I have a server at my office. I just downloaded some files (using scp on the command line). It said I'm getting 3.5 KB/s

I'm an experienced programmer and spend most of my days on the command line and in vim. Networking, however is not a strong point. I've played around with traceroute, but I'm not sure if that's the right tool to use.

I have access to servers all over the country (I would just use Amazon EC2 to set up a test server), and I prefer to use Ubuntu for my testing.

How can I come up with some hard numbers to show Broadstripe how crappy their service is?

EDIT: Above is my original question. I'm going to specify a little more what I'm looking for.

How can I tell where the latency in is happening. I was trying to scp a file from my desktop to a server hosted in the same city. It took a very long time (~2KB/s with some pretty long periods of inactivity). How can I figure out what is causing this?

Answer 1

in general: ping some sites / hosts and see, if packets are dropped, it might indicate broken hardware (modem, router). i once was able to push icmp into the net but nothing (or only some percentage) came back: broken modem.

1. could be dns, do you use a dns-server from your old provider? especially if your traceroute needs as long as it does (it resolves ips to names, your browser normally does the same and page loading can happen only after it found a valid ip for the domain you are aiming at)
2. http://www.speedtest.net/ and ...
3. could be your server as well. try different servers, try downloading bigger stuff from bigger sites (lets say .iso files from microsoft.com or bigger .dmg from apple.com).

Answer 2

The speed test you ran is not necessarily lying to you, bandwidth and latency are two different things. Tools like SCP will suffer because of the nature of the underlying protocol. If you have high latency, TCP connections will make this even more apparent because of the wait time between acknowledgements.

A latency issue is better measured on a site like PingTest.

Answer 3

traceroute is a unix command that tells you how long it takes between each router. The default output is "Then we have one line for each system or router in the path between me and the target system. Each line shows the name of the system (as determined from DNS), the system's IP address, and three round trip times in milliseconds." When I did this on google it tells me I am 21ms away from my ISP and 33ms away from Google.

I'm saying it even though you commented on it because even without any of its flags it tells you how good your isp at getting to you or getting around. What is pretty likely though, is that traceroute isn't at all filtered but a lot is. Try asking Broadstripe what their fair use is, what they will slow down to offer a fair service to all (ask in those words or dumber so they don't think you're trying to get round it).