CA3LE

Why Do My Results Differ From Speedtest.net / Ookla Speed Tests?

56 posts in this topic

The most common question that people ask us is why their results here differ from speedtest.net. I want to explain something that may help you understand why this is.

According to the Ookla Wiki the following is true about your tests taken at speedtest.net...

  • The fastest 10% and slowest 30% of your results are DISCARDED
  • The remaining data is averaged together to determine the final result

Throwing away the fastest 10% and slowest 30% of the results in my opinion does not make for an accurate test. Isn't THAT the data that you're here to see?

Also note this isn't only true for speedtest.net. Ookla is huge, most of the speed tests online run their software.

Source: http://wiki.ookla.com/

post-2-0-05143800-1304725555_thumb.png

Multithreading makes your connection look better
Ookla speed tests are also multithreaded. Meaning that they open more than one connection to the host and combine the speeds. This often can mask congestion issues. For instance, imagine that you have a pipe along your route that's limiting you to 10 Mbps. If you open more than one connection through that pipe you'll be able to achieve a faster speed... but testing that way will not clue you in that there is actually a problem along the route. Remember, you shouldn't have to multithread your connection to pull your full speed.  

 

Multithreaded speed tests, like the majority out there, are designed to benefit the Internet provider not the consumer.  They often display your maximum throughput not your throughput over the course of an entire upload or download.  Omitting the worst portion of your test resulting in inflated scores that may make you feel warm and fuzzy but aren't going to help you see and resolve connection issues.
 
Multithreading can show that you're able to max out your connection by combining the speed of concurrent connections but a great connection can max out without having to multithread.
onytXRV.j6dJz9Y.png

So, if you have to multithread your connection to get your full speed, you should be asking why that is.  With TestMy.net it's instantly apparent if there is a congested route. Your speed here reflects the actual loading time of data within your browser... not the combined efforts of multiple threads being altered (dropping the top 10% and bottom 30% of the results) and added together, all through a plugin that isn't suited for the task.

 

:: EDIT ::

If you'd like to multithread with TMN, I offer that as well.  Try the multithread speed test.  TMN's multithread test gives you the option to select from an array of servers.  Allowing you to test across multiple routes, to more than one server at a time.  TestMy.net is the only Internet speed test with this ability.

So THAT'S why your results differ. :wink:  --  TestMy.net is a harder test to ace and a lot less forgiving than other speed tests.  But isn't that what a benchmark should be?

:: EDIT ::
Another thing to consider is if you're running windows, particularly if it's older than Windows 7 you may need to tune your TCP stack to see your full speeds. Windows doesn't always come out of the box optimized for fast connections. Flash based speed tests fail to detect this problem.

To make this change for free I recommend TCP Optimizer. This makes changing those settings very easy and nearly fool proof. Just open it, slide the bar over to your speed that you're supposed to have, check "modify all adapters" ...apply the settings and reboot. You should have faster speeds after your re-test if that was the problem.

Here's an outside source talking about exactly this issue, I'll hunt down more examples. >> Download Speed Test - Something fishy?

A few related topics ::

 

Outside Sources ::

gvinnnerrra, iceb and Pgoodwin1 like this

Share this post


Link to post
Share on other sites

Great explanation .

At times I'll use there service for a server as close to me as possible , so i can isolate the issue a bit more , true enough , thier closest server generally gives me very close results to yours here at tmn , imagine that.

edit: And that is a 1200 mile difference, let alone a non flash based test.

SecurityDave likes this

Share this post


Link to post
Share on other sites

i usually see very different results than here, when my internet is having issues speedtest.net doesn't usually detect them at all it will show my full 50/5 where as here i can see my service is really suffering and only receiving half that

i actually get better results from here then i see on speedtest.net maybe that's just me...

SecurityDave and FahimAhmedR like this

Share this post


Link to post
Share on other sites

i usually see very different results than here, when my internet is having issues speedtest.net doesn't usually detect them at all it will show my full 50/5 where as here i can see my service is really suffering and only receiving half that

i actually get better results from here then i see on speedtest.net maybe that's just me...

Thanks for the testimonial ;)

Share this post


Link to post
Share on other sites

I also have the 50/5 service. But I regularly see 50-120mbps down from other flash driven sites, but I know that is false. Wish I could pull 100mbps+, but that is just a dream.

Thanks for all your hard work CA3LE!

Share this post


Link to post
Share on other sites

I also have the 50/5 service. But I regularly see 50-120mbps down from other flash driven sites, but I know that is false. Wish I could pull 100mbps+, but that is just a dream.

Thanks for all your hard work CA3LE!

Thanks for the testimonial... keep visiting! :)

Share this post


Link to post
Share on other sites

my results there are always out of this world...great numbers...like vanity sizing...but if i really wanna know if these jeans make my butt big tmn is the looking glass i believe...not always the numbers i wanna see...but hey sometimes the truth hurts...

like right now i'm having an issue that began in early april...most likely my modem...testing here toldl me something is wrong...i called cox and they wanted me to do a test using speedtest inside their network...i said i wouldn't go by that (first off i don't go to any websites or dl anything off their network that i know of)..i told her .that i could already tell her that what it was gonna say...25+...here lately i'm getting 8 or so...so just for the hell of it i took a test there...yep...34...if i went by them i'd never know i have a problem at all...so yes these jeans right now do make my butt look big...but they lied to me

:idiot2:

i love tmn

:smitten:

Pgoodwin1 and tnkk33 like this

Share this post


Link to post
Share on other sites

my results there are always out of this world...great numbers...like vanity sizing...but if i really wanna know if these jeans make my butt big tmn is the looking glass i believe...not always the numbers i wanna see...but hey sometimes the truth hurts...

like right now i'm having an issue that began in early april...most likely my modem...testing here toldl me something is wrong...i called cox and they wanted me to do a test using speedtest inside their network...i said i wouldn't go by that (first off i don't go to any websites or dl anything off their network that i know of)..i told her .that i could already tell her that what it was gonna say...25+...here lately i'm getting 8 or so...so just for the hell of it i took a test there...yep...34...if i went by them i'd never know i have a problem at all...so yes these jeans right now do make my butt look big...but they lied to me

:idiot2:

i love tmn

:smitten:

Very nice testimonial... your charts clearly display where the problem happened. Looks to me like... about April 13th... Funny thing is, your upload sped up at the same time your download decreased.

http://testmy.net/stats/?&t=u&x=60&l=250&q=tdawnaz

Share this post


Link to post
Share on other sites

I use many speed test sites. Testmy.net is by far the most " real time " results you are going to find. Other flash based speedtest sites , aka speedtest,net show your absolute best connection speed with a huge overhead buffer. That is considering NOONE around you is using the internet and you are the ONLY one online that day on your node lol.. If you want accurate, right now speed test results, i use testmy.net. I want to know my connection speeds in real life, not what they possibly can be in absolutely optimal conditions ( again due to the overhead) :smiley6600:.

Share this post


Link to post
Share on other sites
... condensed

and yet you have a 70 mbs results from testmy.net when im pretty sure i saw that your on a 50 mb connection? :)

Share this post


Link to post
Share on other sites

and yet you have a 70 mbs results from testmy.net when im pretty sure i saw that your on a 50 mb connection? :)

Good point... but you failed to factor in that I run this site and I'm purposely trying to break things as I develop. That score is no doubt inaccurate... but it was scored that way durring trials... most likely that score wasn't even logged by the public site that you all see ;)

Here's what I scored on a combined test a few seconds ago... on the public end

XUYLbVo.826vbZp.png

... I also have scores that are only a few kB/s in the database --- never trust my scores out of the database, unless I post a single score... It's part of my development process.

And for comparison here's what I just got on a test moments later at speedtest.net, closest server. (15 minutes later)

1287175001.png

And my server is like 1400 miles away from me.

Share this post


Link to post
Share on other sites

Good point... but you failed to factor in that I run this site and I'm purposely trying to break things as I develop. That score is no doubt inaccurate... but it was scored that way durring trials... most likely that score wasn't even logged by the public site that you all see ;)

Here's what I scored on a combined test a few seconds ago... on the public end

XUYLbVo.826vbZp.png

... I also have scores that are only a few kB/s in the database --- never trust my scores out of the database, unless I post a single score... It's part of my development process.

And for comparison here's what I just got on a test moments later at speedtest.net, closest server. (15 minutes later)

1287175001.png

And my server is like 1400 miles away from me.

Alot of times you cannot choose the closest server on speedtest.net. If i choose Tampa, which is 50 miles away, or Miami, or ANY of the close servers ; i get a 1/4th of my speed. But if i choose Atlanta GA , 900 miles away, or Huston TX , or any of Texas for that matter, i get top speeds :2funny: Go figure.

Share this post


Link to post
Share on other sites

Posted (edited)

and besides...our img is prettier

Edited by tdawnaz
because apparently i couldn't spell when i posted this :-D

Share this post


Link to post
Share on other sites

I use many speed test sites. Testmy.net is by far the most " real time " results you are going to find. Other flash based speedtest sites , aka speedtest,net show your absolute best connection speed with a huge overhead buffer. That is considering NOONE around you is using the internet and you are the ONLY one online that day on your node lol.. If you want accurate, right now speed test results, i use testmy.net. I want to know my connection speeds in real life, not what they possibly can be in absolutely optimal conditions ( again due to the overhead) :smiley6600:.

Thanks,

Yeah, who cares about what your line is capable of. Don't people already know that when they order their service. :evil6:

I didn't originally build this site to be used by anyone except myself... it was part of my 'toolbox'. A way for me to ensure that when I left a customers house they were getting what they paid for. ... I wouldn't build or use a tool didn't serve it's purpose. (that goes for any tool) I'm not a cable installer anymore but I'm my own biggest user of the service. Many of the features the site now has came from my own need for that service. My point is... this site is a tool, not a novelty.

I'm happy and humbled that so many people have chosen my site over the years. Thanks to all the TMN supporters.

- Damon

Cydramech likes this

Share this post


Link to post
Share on other sites

speedtest doesn't usually pull accurate numbers for me.. take now for instance i'm having pretty big local issues here modem keeps dropping out, signals are bad.

so when i test at speedtest its as though nothing at all is wrong.. look

1311960492.png

if i go by that then i'd never know anything is wrong with my connection. but the ISPs can't fool me... i'm going to keep having them come out and look into my issue forcing them to spend thousands until they fix it and give me what i'm paying $89.99 a month for, a good company wants a happy customer and i will be one when they fix my problems which they are trying to do

if i test to testmy.net or any other speedtest site that does not use flash i see results like

MTqEXRu.HG49hlN.png

as you can see speedtest isn't even close. even if i test to a server over 1400 miles away on speedtest its still showing incorrect results

1311966153.png

CA3LE and Pgoodwin1 like this

Share this post


Link to post
Share on other sites

so when i test at speedtest its as though nothing at all is wrong.. look

Thanks for the info, helps prove my point.

Share this post


Link to post
Share on other sites

i to do not see much difference when my connection is working correctly the problem occurs when my connection is sucking, speedtest.net will say everything is fine and this site will validate that my connection is indeed sucking :P

WAfiOIh.TUIsSMu.png1838420512.png

CA3LE likes this

Share this post


Link to post
Share on other sites

Internet Explorer 8. hFgDOPx.png

Also listeing to StreamTheWorld Radio..KKATAM..Salt Lake City.. at the time of test..

Pale Moon (fire fox)..4QNP6Hu.png

Share this post


Link to post
Share on other sites

Called this Morning and they said 1.5 up..but I never get close to that speed, not even 1 Mbs..but they did give me the promo Of 39.95$ a month for a Year.. thats from the 53$.. it will go back to 53$ a month in a year.:) NICE!

Share this post


Link to post
Share on other sites

AT&T Uverse Max pro upto 18 Mbps down....Dont know what the upload suppose to be, funny huh? never get over 950 Kbps.

Yes i see that. Why don't you start a thread in the making it faster section, so we can get more personalized assistance , and get your connections properly set to achieve the best results we can , with what we have to work with.

Because honestly , you should be reaching on average , at least 768 up , with a 1Mb connection.

Post your modem / router model , and the information you just did here , ( for posterity ) , what operating system your running , and any other information you think will help , I'm sure there will be quite a few people here , in there own specialties that are more then willing to get things tweaked with you. In fact most people here are waiting to dig in and help to get the most of your connection.

CA3LE likes this

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!


Register a new account

Sign in

Already have an account? Sign in here.


Sign In Now