The most common question that people ask us is why their results here differ from speedtest.net. I want to explain something that may help you understand why this is.
According to the Ookla Wiki the following is true about your tests taken at speedtest.net...
- The fastest 10% and slowest 30% of your results are DISCARDED
- The remaining data is averaged together to determine the final result
This is no doubt compensation that speedtest.net's programmers have worked into the equation to try and make up for the fact that flash is a bad protocol for speed testing. Looks nice, but because of protocol overhead, buffering and unnecessary CPU usage during the test it doesn't make for an accurate testing platform.
Throwing away the fastest 10% and slowest 30% of the results in my opinion does not make for an accurate test. Isn't THAT the data that you're here to see?
Also note this isn't only true for speedtest.net. Ookla is huge, most of the speed tests online run their software. TestMy.net on the other hand is proprietary and can only be found here.
Multithreading makes your connection look better
Ookla speed tests are also multithreaded. Meaning that they open more than one connection to the host and combine the speeds. This often can mask congestion issues. For instance, imagine that you have a pipe along your route that's limiting you to 10 Mbps. If you open more than one connection through that pipe you'll be able to achieve a faster speed... but testing that way will not clue you in that there is actually a problem along the route. Remember, you shouldn't have to multithread your connection to pull your full speed.
Multithreaded speed tests, like the majority out there, are designed to benefit the Internet provider not the consumer. They often display your maximum throughput not your throughput over the course of an entire upload or download. Omitting the worst portion of your test resulting in inflated scores that may make you feel warm and fuzzy but aren't going to help you see and resolve connection issues.
Multithreading can show that you're able to max out your connection by combining the speed of concurrent connections but a great connection can max out without having to multithread.
So, if you have to multithread your connection to get your full speed, you should be asking why that is. With TestMy.net it's instantly apparent if there is a congested route. Your speed here reflects the actual loading time of data within your browser... not the combined efforts of multiple threads being altered (dropping the top 10% and bottom 30% of the results) and added together, all through a plugin that isn't suited for the task.
So THAT'S why your results differ. -- TestMy.net is a harder test to ace and a lot less forgiving that other speed tests. But isn't that what a benchmark should be?
:: EDIT ::
Another thing to consider is if you're running windows, particularly if it's older than Windows 7 you may need to tune your TCP stack to see your full speeds. Windows doesn't always come out of the box optimized for fast connections. Flash based speed tests fail to detect this problem.
To make this change for free I recommend TCP Optimizer. This makes changing those settings very easy and nearly fool proof. Just open it, slide the bar over to your speed that you're supposed to have, check "modify all adapters" ...apply the settings and reboot. You should have faster speeds after your re-test if that was the problem.
Here's an outside source talking about exactly this issue, I'll hunt down more examples. >> Download Speed Test - Something fishy?
A few related topics ::
- Slow upload, drastically different from other speed tests
- Resuts Vs. Actual Download speeds?
- TestMy.net shows different results than other speed tests
- TestMy v Ookla
- Difference Between Speed Test Sites?
- Satellite Service Testing
- Locking at around 14Mbps
- Questioning speedtest.net
- resolved with TestMy.net
Outside Sources ::
- Use Testmy.net or else!! NO MORE speedtest.net posts will be allowed!!! by the Admin on xplornetsucks.com
- Accurate Speeds Or Speed Test Error? on wildblueworld.com
- (I'll post more examples as I notice them online, I just had these couple of links handy because someone on satellite was telling me that the customer service was saying that TestMy.net doesn't work with satellite, HAHAHAHA. Liars!)
Edited by CA3LE, 25 April 2013 - 12:04 PM.
Added more links