iceb

Instructions to Enable the Beta are in the Private area.
 
The beta is private but members with access are allowed to share instructions.
 
Please use this public forum for all threads related to Beta 23. 
 
If you encounter any issues or bugs please copy the URL in your browser and include it with your post.  This helps reproduce the issue.  Screen recordings are also very helpful.
 
Start new topic  
Happy Testing!

I have some new tools coming out!  And I mean NEW!
 
If you'd like to get an invite when a new Beta is available simply vote on this topic.
 
Currently no ETA but development is moving quickly.
 
I'd like people who are willing to provide feedback but it's not necessary.  Just running the program will give me a lot of useful information.

Oh man! You're really going to love what I'm brewing. Right up your alley!!
 

@japlah I'm sorry I didn't see this when you posted it. I may have been programming.
 
@charles leclair thank you for finding this topic.
 
I think a random interval is a great idea for an automatic speed test option. I'll get that implemented and hit you back on this topic. I'll try to get to it sometime today or tomorrow. I'm going to think about it a little bit first.
 
- D

Thanks CA3LE
 
Totally understand Maintenance Downtime, gotta keep gear updated.
 
Kudos on your ‘Failover’ logic for Test Server selection. When I noted DALLAS was used, I of course checked MIRRORS & no Toronto!?!!
As I wasn’t sure if You were aware of Toronto status so I spoke up.
 
BTW, is DALLAS the Failover Test Site for North America/Continent or Planet  ?
( maybe a Feature Tweak there   )
 
I offer a FEATURE Tweak of MIRRORS :
- specifically for Toronto which currently  lacks duplicate nodes, update the Site Descriptor with ‘Down for Maintenance’ and make Site ‘UN-pickable’ .
 
Thanks again … your site is still the Best Kick-Ass Speed Testing beast !

It was down for maintenance and is back online now.
 
The server list is at https://testmy.net/mirror. Most locations have multiple servers to fall back on but Toronto has much lower traffic so it currently only has one. 
 
Sorry for the inconvenience.  
 

Hi CA3LE,
Got my attention.
 
More modern methods of communication
I would not ask this of just anybody --but I believe it is in your interest to maintain hyper-awareness of web evolution. So, I will ask you.
Where is it going CA3LE? What is the new "modern?" Without revealing any trade secrets, what sort of ideas and directions are you considering?
 
Forums died
They did? Again, you are in the web business. I am not. Thus, your opinion on that is interesting to me.
Since I don't know that forums died, in fact, I consider them very useful, I suspect we are looking at it from opposite ends. Myself, as a consumer, and you, as a forum provider.
Forums are still prolific. Can I assume your message, as a provider, is the return on your investment has faded ?
Or you are getting the band back together and no longer have time for this stuff?
 
These are positively motivated serious questions. I genuinely would like to know how you see business evolving/.
 
--John
 
 
 
 

I'm lurkin' too. Reconfiguring my server cluster for high availability. Some pretty killer backend upgrades. Pretty sweet, all coming together nicely.
 
You may be able to notice when the site has migrated to the new setup. Some really heavy database queries in testing are returning at least twice as fast as they currently do. In the latest configuration I'm running directly off 100% Optane memory. I swear, it's alien technology.
 
It's not about how fast it is, there's faster (on paper, if only scratching the surface -- totally different story in the real-world) -- but it's at what queue depth that matters. And there are NAND drives out there that perform amazing. But what none of them have compared to Optane...
 
Optane can write directly to memory without the need for DRAM cache, it's THAT fast Optane doesn't need to first erase the cell before writing Optane has nearly unlimited write endurance Optane loses no performance as the drive fills up Optane does not require trim (goes on and on really) -- it's in between RAM and NAND  
For my workload it feels the same as going from HDD to solid state. Or from solid state to raid-10 solid state. It's that big of a difference, mind blowing really. Over just a few days of testing I thrashed it with about 60 TB of data and it never broke a sweat -- literally, the drive didn't fluctuate in temp.
 
SMART/Health Information (NVMe Log 0x02) Critical Warning: 0x00 Temperature: 40 Celsius Available Spare: 100% Available Spare Threshold: 0% Percentage Used: 0% Data Units Read: 48,816,551 [24.9 TB] Data Units Written: 105,693,840 [54.1 TB] Host Read Commands: 937,508,694 Host Write Commands: 1,177,333,140  
It just sits there at 40°C like, "Is that really all you've got? Do you realize who I am? HIT ME! I DARE YOU! This is my idle temp FOO!"
 
 -- in other words, it's bad ass. It's a different kind of memory entirely.
 
Old but relevant video describing 3D XPoint (cross point)
 
 

Definitely need to work on SEO.
 
Best thing people can do is spread the word. 
 
And you're right, to the casual user -- they have no idea what makes TMN unique. Unfortunately the majority just follows where the rest of the crowd goes. A vicious cycle, feeding into itself.      -- implications far deeper than just speed tests.  lol
 
One of these days I hope to get my message across better, where more people want to engage. Until then, all I can do is keep developing. At the end of the day, I'm happy just serving those who already understand the difference.
 
Forums everywhere in general, died. The Internet changes and you have to change with it. I may eventually push the forums off into an archive in favor of a more modern method of communication.

I'm not now nor have I ever been a member of Facebook,Twitter,etc.
I have no plans to ever be.
They have their own political agenda.
One that is usually opposite to mine.
So I like forums.

To me, that seems like either high packet loss or intermittent drop-outs, both which you can check by running an extended ping test while streaming.
 
On a Windows PC, open a command prompt (Start -> Windows System -> Command Prompt) and type the following command:
ping -t 8.8.8.8  
You should see a continuous run of "Reply from 8.8.8.8".  Leave that window open and start streaming a programme. 
 
As soon as the streaming stalls, check the window for any "Request timed out" lines.  If you see three or more in a row, your connection had a brief outage.
 
Press CTRL + C on the keyboard to stop the ping utility.  Look at '% loss' figure.  If that is 1% or higher, scroll up by holding the mouse down on the top-right up-arrow and look out for lines that say 'Request timed out'.  If you see three or more grouped together, that is another brief outage.  If you come across five or more 'Request timed out' lines in one screen-full, this is a high packet loss issue, which can also interrupt streaming. 
 
I've had an issue in the past with at least 3 D-Link routers failing with a high packet loss with this exact symptom, i.e. no issue with browsing or speed tests, but could not reliably stream YouTube.

Update: The new upcoming version of TestMy.net will not fail on all major updated browsers.  I've implemented service worker which enables TestMy.net offline... obviously you won't be able to test in that state but it is helping me to make this correct and more useful for you (and myself).  Gives me abilities as a developer that I've never had before.  
 
I've run numerous batches of tests, purposely disconnecting the internet.  The new version has never failed.  It will log those events too, doesn't right now but it will.  I like your idea for implementation...
 
 
It will detect when you're online, wait.. check again to make sure it wasn't just intermittent... then test again when it feels it's able to..... might not be able to complete the entire test still but it will try then possibly fail again and restart the re-try process.
 
I can tell the averaging and database listing programs as a whole to ignore exactly "zero" so it doesn't effect host averages or flood public results... I don't know what would happen other wise so better plan for it.  Especially since that's a point for clients to purposely negatively affect hosts numbers.  (I always want to limit the input received but users... sorry users.  Damn bots and hackers ruined your rep.)  ...that idea provides a simple way to implement without having to add databases or change database structure.  I like that.   --- database structure changes can be an extreme headache, especially since I promised since the beginning that I'd retain all of your old results.
 
I'll keep developing.  The update I'm on right now started purely as a design venture, the more major feature rich updates are still planned...but I've been stumbling on so many answers it's become far beyond just what people see at this point.  There is still so much planned, I'm only including the features that I feel are ready.   ... I'd rather be on this new site (all day long).  I make TMN first as something I want to use... but I'm hoping to attract more than people of just own own mindset.  Anyone still reading this is probably of that mindset.  Most will never get as far as you.  I want the other 98% to get it too.  Hopefully this gets a little closer.
 
For people who have been long time visitors, keep your old browsers on virtual machines.  I need your help testing old browsers but also keep in mind that I'm developing for the future, I'm no longer concerned about lagging browsers or wasting my development time around their inconsistencies.  I target technologies native to the most popular browsers across the board.  If one browser has janky implementation, I may still release it as long as it's not detrimental to the test results or experience.  IMHO, Safari is the new IE right now.  Annoying.  Chrome, Firefox, Chrome on iOS and Android (period) are the best right now.  I expect Safari to catch up, sorry, it's not on the developer when everyone else agrees.
 
By the way, I straight up killed most old browsers when I went full SSL.  Full SSL is 100% necessary for the future of what TMN is doing.  Sorry old browsers.  Trust me, I took a hit with traffic.  When I see software changing ads in browser or including ads to pages I don't have ads on... that showed me early why we need SSL (https).  With SSL that can only happen if the cypher is cracked. 
 
To be honest at first I thought, why would TMN need https?  Nobody is buying anything from my site or really sending anything truly secure.  Uh, think again.  Many people may use the same passwords.  Hackers can grab that information as you login at a public wifi and then try the same email address and password on google, facebook, ebay, amazon, etc... till they get a hit.  So stupidly easy for hackers.  Not only that but third party ads may be doing things you don't want... far outside of the scope of common practice (of which some people already may not already want).  And again, a third party program can also edit your webpages and add their own content.  Above all, they want to make money, usually ad or code insertion is the intent.  With the latest SSL people can't do the same malicious stuff.  Not to say it can't be done again, it can always be done again.  Nothing made by man can be protected from man.  What is created from one man's mind can always be decoded in another's.  We just need to evolve with the changes. 
 
way off the subject... AI teaching itself to make new cyphers and then keeping the true keys from us, that worries me the more I think about it.  An AI or AIs will invent their own language that we can't possibly understand in our lifetimes.  It will be so efficient that humans can't understand it because we don't work well enough, lol.  Take the highest level of cryptography that you can think of exponentially increase that.  And then realize that the program that creates it may be so obscure that it could be hiding information from us, making us feel secure when it really has all the power.  I say let us humans keep making mistakes and figuring out each other's mistakes and improving naturally.  We as humans should always in great detail fundamentally understand our software and hardware changes... it should never be obscured to the point that no human can understand.  I worry that we'll let computers do our programming and designing to the point that we'll have little understanding of what's truly under the hood or how to control it.  "let the computer figure out how to do that better, it will make it perfect." -- it's cool until it starts talking in a language you can't decode and decides you're not a part of understanding that language simply because you as a human aren't optimal to the system.  To a computer, even our VERY best languages are stupid because they aren't optimal and so that's the first thing to go in my opinion.  This has already happened by the way, just not to a serious degree.  A real AI will be ahead of our moves before we even start moving.  Once you know it's happening, it's too late.  I'm have to be high on the AI's list now.         (haha)
 
I believe our community here is made up of people who set the standard for their own communities in regards to all things tech.  We should set the standard by example.  Have your main machines always updated and encourage friends to do the same.  Hardware and software.  Especially software.  And especially right now because there have been so many major updates that EVERY browser is agreeing on.  They don't normally agree like this.  Over 21 years developing in the browser and I've never seen such wide adoption of so many cool new features.  What a great time to develop.
 
Anyone who may be still actually reading this and wants access to the beta, just PM me.  If you were a member of any discussion on TMN prior to this post you can have access to the early beta too.  A handful of our veteran members have agreed to help me even early to make sure we give you a clean release but there are always more bugs that we need help finding. 
 
-- we'll find 'em together ...and make some more in the process!  Human's Rule.  
 
-D

I'll keep this in mind when I start on the database searching improvements.  Development on that will start shortly after the new beta is released.
 
What I was planning on doing is having it aggregate the user agent information.  So it will search through your result details, group the user agents and allow you to do more detailed searches.  You'll also be able to select multiple identifiers.  So you can select "Android & iOS" for instance or select the inverse to see only desktop and laptop results.
 
If you want to be part of the beta group, vote "Yes" on this topic >> 
 
 
It's an old topic from the last beta of the version you're using today... a fresh beta is coming soon.
 

I ran an automatic test and the provider service was so bad at times that the test timed out.
But this is not reflected in the results.
 
I copied the results into Excel and made my own graph with the results including zero speed when the test timed out.
(See included image of results with zero results included)
The graph with those zero results included shows a true picture of the service while the website graph show a better level of service.
 
I think zero speed (timeout) results should be included...
 
Noel

Hi Ed,   Send me a link to your results so I can inspect further.  Visit https://testmy.net/myresults then copy and paste the URL that loads in your browser back to me. - D    
When the page loads, do you see a progress bar at all?  Does the progress start at 0%, then quickly go up to 100% or does it load without progress?   Let's try this.  http://co.testmy.net/dl-256  -- a minor modification was made to the program on this specific server.  So follow that link.   Thank you for your help, - Damon   ----   Hi Ed,   I see that it worked.   I updated the codebase and it's propagated to all of the servers.   Go ahead and re-test on the Dallas server you were using before https://testmy.net/dl-256 and hit me back.    
Sweet.  And no problem, glad you were able to work with me.  I've seen some results like that but I haven't been able to reproduce.  If you ever see anything that I need to work on, please never hesitate, you have my email.  If it's of high importance, like this was, I'm on it!
  Looking at your results got me thinking about what might cause that.  Looking at the code as if I were a web browser trying to optimize the data flow I noticed something... the way I'm hiding the data being loaded could easily be interpreted as something it can skip over.  So I rewrote that little tiny portion of the method... now, I think a browser would be crazy to skip over it because it's part of the DOM.  Even though it's hidden, the browser assumes that it may be called upon later on so it should always load that information now.   You must have some kind of option enabled, extension or installed program that removes 'comments' from the code.  It was being commented using common HTML comments <!-- -->.  If you can think of what's different on your computer that may have caused this, I would love to know so I can write about it.  Please email me back any time.   Please take a few seconds and join TestMy.net.  I need more people like you, members get new features before the general public and if your IP changes TMN will keep track of your results better if you're registered.   Thank you, thank you, thank you for working with me on this.  You've definitely made TestMy.net better.   I hope you like what I'm building and spread the word.  Nobody knows about TMN unless you tell them.   - Damon    
 
Ed,
  Not sure if you saw the other reply I made.  Can you run this for me when you get a chance.   https://testmy.net/dl-256 -- just to confirm on the server you were previously using.  
OpnSense could have had something to do with it but then you said you bypassed that.  So it must be something else.  Something common to all of those machines but uncommon for most other machines.
  I guess what matters the most is that it's working properly under whatever configuration caused the problem.   Thanks again Ed, I look forward to seeing you around.  Happy Testing! - Damon

The speed test probably isn't the best tool for testing that.  I think you need to be monitoring ping instead.
 
Running TestMy.net's speed test on all of your machines on a regular basis will use up a lot of your network bandwidth and may cause problems depending on the pipe you have.  I wouldn't do it.  When I use the automatic speed test I do so to test fluctuations, not uptime. 
 
One thing you can do is use TMN's automatic response time testing.  Every time you load a page on TMN's frontend (any page outside of the forums) it will test that machine's response time.  This action only uses bytes of data.  It's possible to call the page up and have it test automatically on an interval, I'll just have to dig into the program a little to find the commands.  Currently if it encounters a timeout it isn't logged but in the future this will be reported in your RT database results.
 
If you want to differentiate the machines you can select a unique identifier for each machine.
 

 
If you have it set to test on a regular interval you be able to see holes in the results when you click details.
 

 
As long as you're signed in your RT will be tested each time a page load occurs.  You can do this even without using TMN to reload the page.  Make a simple HTML meta refresh script, make it refresh a minimal page on TestMy.net.  https://testmy.net/blank.php is already there for this purpose.  Before starting the script just open a browser window, log in to TMN and select an identifier so you can tell which machine it is.  The frequency shouldn't be set lower than about 15 seconds... the time it takes for the RT test to run and send the request to log it's result to the database.
 
I hope this helps.

Can you post examples?  I looked through your results and didn't find any that looked like that.  Maybe you deleted them.
 
You were talking about the TiP result, within the individual test results, correct?  Keep in mind that your overall score is calculated completely separate from the TiP result.  The TiP minimum, maximum and average are taken from calculations that are separated from the main event.  
 
Some of your tests are running more smoothly...
https://testmy.net/db/ozEV43YIP

...and some look like a struggle to get to the end.
https://testmy.net/db/HvlNtJKXk

Obviously, it's best if it runs like the first scenario most of the time.  But if you see an extreme spike either way and then it's followed by normal plots, simply disregard it.  If you have time, send me a private message with the TID so I can look at it and use the information to improve the algorithm.  But keep in mind when that happens, your overall result is not affected.  It's not as if the TiP result aggregates into the final result... TiP is a totally separate entity.
 
I may put a 'report inaccurate results' link in an upcoming version to make it easier for users to flag results for a closer look.  In this case, I personally never see spikes like you're seeing.  It's hard to program a fix for something when you can never see it yourself.  But I do learn from your results and apply it.  I often spend hours going through live results to look for anomalies.  TiP is already much more accurate than the original concept but I know there's always room for improvement.
 
I think the issue on some machines is that something in your software configuration is causing intermittent delays in browser transactions.  When these delays happen during the test it causes a misreporting of the TiP numbers.  Probably because the times are taken so closely together.  
 
Sometimes the fact that a computer is not able to run TMN like the majority of the population is a clue.  Example, my friend _____'s laptop can hardly run TMN right now.  It used to run it perfectly (another clue that something new is up) and all of the other computers and devices on his network run TMN to the best of the networks ability.  The issue is in loading.  The test loads and runs but seems to get hung up on the forwarding around that TMN does during the test.  Disabled his virus and internet security protection, because sometimes those programs have been known to cause issues... nope.  Still does it.  Now if this were anyone else I might dig deeper but he admits that he does things online that he probably shouldn't, opens and clicks things that he shouldn't, etc.  Per my recommendation he's backing up his files and I'm going to format it and reinstall windows for him.  I guarantee, when it boots up... it will no longer have that issue.  Sometimes you don't even have to get to the results page to get a result at TMN.  Hell, I often start a test and cancel it part way through because I got the point of how it's running just by how it loaded.
 
Please forward me those results in the future so I can make sure it's not something I can improve on.

A large number at once would be preferable. I've built an Excel document to display my speeds during certain times of day but the biggest issue (from individual tests) appears to be the TIP middle variance. I'd like to graph this to see if it is affected during certain times of day and correlates with my speeds.
 
If others find the graph helpful I will post it publicly when I finish!

@tdawnaz it shows in your notifications.
 

 
 
I plan on building this into the new user settings area coming soon.

 
https://testmy.net/group
 
Here's an invite: https://testmy.net/invite/awesome/lAoun43

As I noticed some ISPs return considerably quicker speed tests with Ookla's speed than what's possible with regular web access including TestMy, I decided to snoop at how Speed test establishes its connection using Sysinternals' TCPView utility.  I sorted the traffic by 'Received Bytes' and then started a speed test.
 
While the multiple connections doesn't surprise me (Ookla's tests are all multi-threaded), what I was surprised with was what port it used - 8080:
 

 
It seemed like no matter what test server I tried, it ran its test over port 8080, which is a seldom used port for web traffic.  For example, HTTP and HTTPS traffic are carried over ports 80 and 443, respectively, while FTP traffic is carried over ports 20 and 21.   Port 8080 is typically used for an internal web proxy within corporate networks and for an ISP cache proxy in the early days of Internet for faster access to popular websites.
 
On the other hand, by running the speed tests over port 8080, this makes it easy for ISPs to prioritise traffic for anyone using Ookla's speed test as all they have to do is give elevated QoS for traffic running over port 8080.
 
I then thought - Is port 8080 necessary for Ookla's Speedtest?  To find out, I blocked port 8080 on my PC.
 
The speed test took a little longer to start, but once it did, it switched over to port 80, in this case with two threads:
 

 
Once I open up port 8080 and click 'Test Again', the next test runs on port 8080 again.
 
So an interesting idea would be if TestMy could add support for port 8080.  I don't think it will require much configuration other than configuring the various test servers to also accept traffic on port 8080.  Then it would just be a matter of typing testmy.net:8080 to perform the test on port 8080 with suspect ISPs, such as those that seem to throttle ports 80 (HTTP) and 443 (HTTPS).

 
 
opera_mini_proxy and opera_software_asa and opera_software_america will no longer be detected as being in a city or country.  Stats already saved to city and country databases are being removed right now.  Hope this helps. 

The upload speed test currently doesn't show a "TiP" graph of the speed over time like the download test does. The curve of this graph could allow one to determine the presence and effectiveness of an advanced congestion control algorithm (ctcp, cubic). I would also like a precise readout of the Initial Congestion Window, which is essentially the first data point of the graph. This parameter is now configurable in modern OS, but it can be difficult to tell if the tweak has been correctly applied. In my opinion the upload graph is more useful, because in the opposite direction a TestMy server is always capable of uploading fast, while much more variety exists in residential connections and operating systems.
 
 
 
 
Although my browser does show the current upload speed of standard HTTP posts, the reading doesn't have good enough resolution.

So you have Endeavor Communications, Endeavor E-FORCE.  

 
I'm guessing 15/3 ... and if it's not then your problem is worse than I thought. (or they're really delivering on that 6 Mbps package, lol)  So when you're performing right, it's pretty nice.  But those dips hurt.  How often is this happening and how long does it last?
 

I do see a pattern in there.  Your worst results are between ~25 and ~45 minutes past the hour.
 
Try an hour long test first.  auto speed test, download / express off / every 5 minutes / 12 times.
 
If you see a specific time that your speed drops, start the next test (below) during that time frame so that you can see if it's happening every hour.
 
Run a longer auto speed test, download / express off / every hour / 24 times.
 
When the speed drops that heavily I start looking into the possibility of another computer on my network doing something that's eating up all the bandwidth.  Maybe someone in your house is torrenting or maybe your wifi isn't secure and a neighbor is leeching your bandwidth.  You'd be surprised how often that's the case.
 
When it happens with perfect regularity I start looking into automatic scheduled tasks I may have across all the computers within my network.  A large backup sync that happens at the same time every day for instance may choke your bandwidth.
 
Run that scheduled test, it will help us understand better.  If it's happening only during a certain time of day it could be congestion in your area.  If it's happening very frequently where your speed is constantly up and down it may be your equipment.  There are so many possibilities but we'll try to help you nail down the problem.

That's on your smart TV, right? Typically when we see results like that on a computer we suggest TCP Optimizer. Optimizing the TCP and MTU settings will often bring the single thread score up to the multithread result level. You may not be able to change these settings on your TV, I would almost bet that you wouldn't be able to.

Sometimes if the drive performance is lacking single thread tests here will suffer.
 
Here's results from a Macbook.  The first 9 results were taken with a failing mechanical HDD.  The last 4 stable results were taken after the HDD was swapped for a SSD.

In hindsight I should have done some multithread tests to show you that multithread is usually unaffected in this scenario.  But I didn't know I'd be sharing the results at the time... I just wanted to quickly fix my friends laptop.  I could tell just by how the first few tests felt while they ran that it was the hard drive holding it back, plus I had already diagnosed it with multithread test comparison a month prior.  Did a swap for SSD, rebooted and instantly 90 Mbps ... over and over again.  Everything ran better by the way... I just tested it through the Internet and TMN.  ... Note: if I only had 15 Mbps Internet I wouldn't have been able to see the issue.  It's only at extreme speed that you can start using TMN for purposes beyond what I originally intended it to be used for.
 
It's not always the Internet connection and ISPs fault.  Hardware can hold you back too.  TestMy.net is not just a bandwidth test... it started as a bandwidth test but at higher speeds we've found it does much more.
 
Those results (from a TV on your connection type) look good to me.  That's a comfortable speed to surf at.  It would be better if both types tested at 35+ but I wouldn't get too hung up on it either.  That's not a bad performance.  It may be held back by the speed of the TV's memory... why things like that only affect my classic test, I don't know.. they just do. But now, when you get your next tv... you'll know how to benchmark the difference.