Jump to content

Remove extreme maximum / minimum from test results


Recommended Posts



I'm trying to follow my speed over some date range.

And results are eg: 35, 55, 50, 40, 60, 290, 45 55 ...

At some point among 20 tests I got some extreme result (like 290 in upper example).

This extreme result is giving me wrong average speed.

So average calculation should remove extreme maximums and minimums.


Can I fix this somehow?


Link to comment
Share on other sites

Can you post examples?  I looked through your results and didn't find any that looked like that.  Maybe you deleted them.


You were talking about the TiP result, within the individual test results, correct?  Keep in mind that your overall score is calculated completely separate from the TiP result.  The TiP minimum, maximum and average are taken from calculations that are separated from the main event.  


Some of your tests are running more smoothly...


...and some look like a struggle to get to the end.


Obviously, it's best if it runs like the first scenario most of the time.  But if you see an extreme spike either way and then it's followed by normal plots, simply disregard it.  If you have time, send me a private message with the TID so I can look at it and use the information to improve the algorithm.  But keep in mind when that happens, your overall result is not affected.  It's not as if the TiP result aggregates into the final result... TiP is a totally separate entity.


I may put a 'report inaccurate results' link in an upcoming version to make it easier for users to flag results for a closer look.  In this case, I personally never see spikes like you're seeing.  It's hard to program a fix for something when you can never see it yourself.  But I do learn from your results and apply it.  I often spend hours going through live results to look for anomalies.  TiP is already much more accurate than the original concept but I know there's always room for improvement.


I think the issue on some machines is that something in your software configuration is causing intermittent delays in browser transactions.  When these delays happen during the test it causes a misreporting of the TiP numbers.  Probably because the times are taken so closely together.  


Sometimes the fact that a computer is not able to run TMN like the majority of the population is a clue.  Example, my friend _____'s laptop can hardly run TMN right now.  It used to run it perfectly (another clue that something new is up) and all of the other computers and devices on his network run TMN to the best of the networks ability.  The issue is in loading.  The test loads and runs but seems to get hung up on the forwarding around that TMN does during the test.  Disabled his virus and internet security protection, because sometimes those programs have been known to cause issues... nope.  Still does it.  Now if this were anyone else I might dig deeper but he admits that he does things online that he probably shouldn't, opens and clicks things that he shouldn't, etc.  Per my recommendation he's backing up his files and I'm going to format it and reinstall windows for him.  I guarantee, when it boots up... it will no longer have that issue.  Sometimes you don't even have to get to the results page to get a result at TMN.  Hell, I often start a test and cancel it part way through because I got the point of how it's running just by how it loaded.


Please forward me those results in the future so I can make sure it's not something I can improve on.

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Unfortunately, your content contains terms that we do not allow. Please edit your content to remove the highlighted words below.
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

  • Create New...