Confused about average results - how about a histogram?

[wmertens]

I'm trying to compare iWay and Init7 in Switzerland, and in the rankings iWay seems to score twice as fast as Init7, but when you go to the individual stats, Init7 way outscores iWay.

 

Ranking: https://testmy.net/country/ch#isps

• #1 iWay: 1811.4 Mbps 2152 Mbps  316 Mbps   47 clients took 356 tests recently
• #2 Init7: 624 Mbps 871 Mbps  154 Mbps   67 clients took 183 tests recently

 

Individual stats:

• iWay: https://testmy.net/hoststats/iway, Averages 326.7 Mbps / 85.3 Mbps | 81 ms, last 1000 download: 195.7, upload: 117.4
• Init7: https://testmy.net/hoststats/init7, Averages 621.6 Mbps / 227.8 Mbps | 72 ms, last 1000 download: 1265.3, upload: 146.9
  
  I don't understand how these numbers are related?

In any case, I think a histogram would be way more useful for the individual stats, it would show the different kind of connections an ISP has.

[CA3LE]

The stats that show under hoststats are taken over longer periods and have more results considered.

 

The stats that show under the ISP ranking tab are done in the background every 15 minutes and only consider the most recent results.

 

My next major hoststats update will use the same numbers for everything.  Using the overall average shown on the current hoststats pages.

 

I think a histogram is an excellent idea, I'll be working on that.

 

With less than 300 results each, it's hard to compare.  The dataset on those providers is very small.  If you click the "Log" button on the hoststats pages you can see the number of results.  iWay looks better... but Init7 has a slightly larger sample.

 

[wmertens]

Ok I see, by using a continuous stream you're signaling something that the ISP may optimize for, and it's not representative of actual use, right? I think it bears explicitly stating this in the explanation.

 

Really loving the beta BTW, it's so great to see the packets come in, and also to see how speed varies during the test. When will it go live?