DraganFill

Remove extreme maximum / minimum from test results

3 posts in this topic

Hi,

 

I'm trying to follow my speed over some date range.

And results are eg: 35, 55, 50, 40, 60, 290, 45 55 ...

At some point among 20 tests I got some extreme result (like 290 in upper example).

This extreme result is giving me wrong average speed.

So average calculation should remove extreme maximums and minimums.

 

Can I fix this somehow?

 

Share this post


Link to post
Share on other sites

You can manually remove a test point result. Go to Results. At the right side of the table, there's check boxes and a remove function.

 

not sure how your extreme data point happened.

 

@CA3LE may have an idea.

Share this post


Link to post
Share on other sites

Can you post examples?  I looked through your results and didn't find any that looked like that.  Maybe you deleted them.

 

You were talking about the TiP result, within the individual test results, correct?  Keep in mind that your overall score is calculated completely separate from the TiP result.  The TiP minimum, maximum and average are taken from calculations that are separated from the main event.  

 

Some of your tests are running more smoothly...

http://testmy.net/db/ozEV43YIP

...and some look like a struggle to get to the end.

http://testmy.net/db/HvlNtJKXk

Obviously, it's best if it runs like the first scenario most of the time.  But if you see an extreme spike either way and then it's followed by normal plots, simply disregard it.  If you have time, send me a private message with the TID so I can look at it and use the information to improve the algorithm.  But keep in mind when that happens, your overall result is not affected.  It's not as if the TiP result aggregates into the final result... TiP is a totally separate entity.

 

I may put a 'report inaccurate results' link in an upcoming version to make it easier for users to flag results for a closer look.  In this case, I personally never see spikes like you're seeing.  It's hard to program a fix for something when you can never see it yourself.  But I do learn from your results and apply it.  I often spend hours going through live results to look for anomalies.  TiP is already much more accurate than the original concept but I know there's always room for improvement.

 

I think the issue on some machines is that something in your software configuration is causing intermittent delays in browser transactions.  When these delays happen during the test it causes a misreporting of the TiP numbers.  Probably because the times are taken so closely together.  

 

Sometimes the fact that a computer is not able to run TMN like the majority of the population is a clue.  Example, my friend _____'s laptop can hardly run TMN right now.  It used to run it perfectly (another clue that something new is up) and all of the other computers and devices on his network run TMN to the best of the networks ability.  The issue is in loading.  The test loads and runs but seems to get hung up on the forwarding around that TMN does during the test.  Disabled his virus and internet security protection, because sometimes those programs have been known to cause issues... nope.  Still does it.  Now if this were anyone else I might dig deeper but he admits that he does things online that he probably shouldn't, opens and clicks things that he shouldn't, etc.  Per my recommendation he's backing up his files and I'm going to format it and reinstall windows for him.  I guarantee, when it boots up... it will no longer have that issue.  Sometimes you don't even have to get to the results page to get a result at TMN.  Hell, I often start a test and cancel it part way through because I got the point of how it's running just by how it loaded.

 

Please forward me those results in the future so I can make sure it's not something I can improve on.

wenfinger likes this

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!


Register a new account

Sign in

Already have an account? Sign in here.


Sign In Now