Gio Bacareza Posted October 30, 2015 CID Share Posted October 30, 2015 (edited) I did a series of hourly tests and I noticed something which I found strange. Speeds measured when sending at smaller sizes (256 kB) almost invariably measures slow speeds (averaging 20Kbps). Is this normal? What's the explanation? details of measurements: https://testmy.net/stats/?&t=u&d=10302015&x=60&l=500&q=Gio%20Bacareza Edited October 30, 2015 by CA3LE added graph Link to comment Share on other sites More sharing options...
CA3LE Posted October 30, 2015 CID Share Posted October 30, 2015 That would be a first. What happens with a 512 kB download test? I was just looking at your results before you posted, thinking... geeze, going off his worst result... it would take this guy 85 minutes to download a 5 MB file. What happens with a 512 kB download test, 10 MB download test or 20 MB download test? Do those test around the same time. No need to post the results just tell me when you're done. Link to comment Share on other sites More sharing options...
Gio Bacareza Posted October 30, 2015 Author CID Share Posted October 30, 2015 19 minutes ago, CA3LE said: That would be a first. What happens with a 512 kB download test? I was just looking at your results before you posted, thinking... geeze, going off his worst result... it would take this guy 85 minutes to download a 5 MB file. What happens with a 512 kB download test, 10 MB download test or 20 MB download test? Do those test around the same time. No need to post the results just tell me when you're done. Hi thanks for quick response. I tried to do download tests with manual sizes and testmy.net proceeded to tests from 512 up to the highest. However the logged results did not include 512. I tried to do it thru the links you provided, still the same. results: Date Type Size kB Test Size Converted Score Kbps Score Mbps Score kB/s Score MB/s Username Computer ID ISP / Host Extra Identifier Test ID 10/30/15 13:35 DN 35328 34.5 MB 18597 18.16 2325 2.27 Gio Bacareza 4.50691E+12 philippine_long_dist 61------ph uolJayCMA 10/30/15 13:31 DN 40832 39.9 MB 23639 23.08 2955 2.89 Gio Bacareza 4.50691E+12 philippine_long_dist 61------ph pLW7sEPIc 10/30/15 13:30 DN 12096 11.8 MB 15140 14.79 1893 1.85 Gio Bacareza 4.50691E+12 philippine_long_dist 61------ph AukrcLzIH Anyways here's the text results: :::.. Download Speed Test Result Details ..::: Download Connection Speed:: 25899 Kbps or 25.9 Mbps Download Speed Test Size:: 50.9 MB or 52096 kB or 53346304 bytes Download Binary File Transfer Speed:: 3237 kB/s or 3.2 MB/s Tested At:: http://TestMy.net Version 15 Validation:: https://testmy.net/db/xHpN6TKJl TiP Measurement Summary:: Min 11.2 Mbps | Middle Avg 29.99 Mbps | Max 35.64 Mbps | 52% Variance TiP Data Points:: 11.2 Mbps, 25.44 Mbps, 29.32 Mbps, 32.82 Mbps, 35.26 Mbps, 31.23 Mbps, 30.79 Mbps, 32.77 Mbps, 31.2 Mbps, 34.5 Mbps, 35.64 Mbps, 33.74 Mbps, 35.39 Mbps, 25.46 Mbps, 20.91 Mbps, 23.68 Mbps, 24.75 Mbps, 27 Mbps, 29.43 Mbps Client Stats:: https://testmy.net/quickstats/Gio%20Bacareza https://testmy.net/compID/4506914847577 Test Time:: 2015-10-30 13:43:13 Local Time Client Location:: PH https://testmy.net/country/ph Target:: San Jose, CA US http://west.testmy.net Client Host:: Philippine Long Distance Telephone https://testmy.net/hoststats/philippine_long_dist Compare:: 1846% faster than host avg, 1982% faster than country avg, 68% faster than world index 1MB Download in 0.32 Seconds - 1GB Download in ~5 Minutes - 462X faster than 56K This test of exactly 52096 kB took 16.491 seconds to complete User Agent:: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/46.0.2490.80 Safari/537.36 [!] Are there steps I'm missing? thanks Link to comment Share on other sites More sharing options...
CA3LE Posted October 30, 2015 CID Share Posted October 30, 2015 You're fast enough right now that it wants to force a large size on you. We can override that... but I feel like we got the information we needed out of those tests. You're in the Philippines, right? Have you tried testing against the server in China? Select other speed test servers. Can you also run another 256 kB download test? If it gives you a super low score again run the 20 MB test above. Have you been running into this while running the Auto Test only or does it do this all of the time with the 256 kB block? I think what's happening is that you're having a very slow start, followed up by much faster speed. When it's spread over a much longer test the pause at the beginning has less affect on the result. I assume that you're seeing a pause of some kind before the test rockets off... right? Link to comment Share on other sites More sharing options...
Gio Bacareza Posted October 30, 2015 Author CID Share Posted October 30, 2015 34 minutes ago, CA3LE said: That would be a first. What happens with a 512 kB download test? I was just looking at your results before you posted, thinking... geeze, going off his worst result... it would take this guy 85 minutes to download a 5 MB file. What happens with a 512 kB download test, 10 MB download test or 20 MB download test? Do those test around the same time. No need to post the results just tell me when you're done. sorry wasn't quite following your instructions (it's because I noted a strange behavior with the 512) but I've done the 3 tests now. thanks PS. do check the behaviour of 512. It's different from the 10MB and 20MB because it tests all sizes starting from 512 while 10 and 20 just tests at those sizes only. FYI Link to comment Share on other sites More sharing options...
CA3LE Posted October 30, 2015 CID Share Posted October 30, 2015 1 minute ago, Gio Bacareza said: PS. do check the behaviour of 512. It's different from the 10MB and 20MB because it tests all sizes starting from 512 while 10 and 20 just tests at those sizes only. FYI That's what it's supposed to do if your connection is fast enough. If it allowed you to test with only 512 kB when you have, say, 20 Mbps... the end result would be far from an accurate picture of the connections true capability. TMN's seeing that you're too fast for that size so it's forwarding you on to what it believes is a more appropriate size. Link to comment Share on other sites More sharing options...
Gio Bacareza Posted October 30, 2015 Author CID Share Posted October 30, 2015 (edited) 19 minutes ago, CA3LE said: You're fast enough right now that it wants to force a large size on you. We can override that... but I feel like we got the information we needed out of those tests. You're in the Philippines, right? Have you tried testing against the server in China? Select other speed test servers. Can you also run another 256 kB download test? If it gives you a super low score again run the 20 MB test above. tried with Server in HK and at 256 as instructed. here results https://testmy.net/db/SKpznXshW tried again with 20MBS https://testmy.net/db/kKz~udEh7 Edited October 30, 2015 by CA3LE converted to graphical Link to comment Share on other sites More sharing options...
Gio Bacareza Posted October 30, 2015 Author CID Share Posted October 30, 2015 11 minutes ago, CA3LE said: Have you been running into this while running the Auto Test only or does it do this all of the time with the 256 kB block? I think what's happening is that you're having a very slow start, followed up by much faster speed. When it's spread over a much longer test the pause at the beginning has less affect on the result. I assume that you're seeing a pause of some kind before the test rockets off... right? I only run auto tests and on fire and forget mode, ie i set the the frequency usually every hour for the next 24 hours. I'm not sure about the PAUSE. I have not configured any. Like I said, it's fire and forget. So I only noticed it when I tabulated and analyzed the results. I'm quite concerned because I've raised a ruckus with PLDT, my ISP, and they're scrambling to fix it. (I've shown them the the table with further analysis like histograms and regression curves. hehe) But it seems that I have the high speeds but TMN is just reporting the 20Kbps at 256MB as the table shows because of the way the test works? Link to comment Share on other sites More sharing options...
CA3LE Posted October 30, 2015 CID Share Posted October 30, 2015 3 minutes ago, Gio Bacareza said: I only run auto tests and on fire and forget mode... So you are using the auto test. Have you ever been at the computer when this happened? 3 minutes ago, Gio Bacareza said: But it seems that I have the high speeds but TMN is just reporting the 20Kbps at 256MB as the table shows because of the way the test works? It's reporting the speed that it experiences. If your result is 20 Kbps on a 256 kB test... it had to take over 100 seconds to load to log a result that way. The programming is straight forward and doesn't work any other way. I think you're having an issue during those times or your bandwidth is in use... that would definitely cause that to happen. Like if you're downloading something, then the auto test pops off... the end test result will be minus the speed of any transfers in process. If you do find for some reason that you have issues with the 256 kB test you can always manually select your test size. Selecting 'nfw' checkbox on the Auto test will force it to not forward you... there are still some minimum requirements. Certain circumstances will always force a forward to a larger test. Link to comment Share on other sites More sharing options...
Gio Bacareza Posted October 31, 2015 Author CID Share Posted October 31, 2015 On 10/30/2015, 1:08:35, CA3LE said: So you are using the auto test. Have you ever been at the computer when this happened? It's reporting the speed that it experiences. If your result is 20 Kbps on a 256 kB test... it had to take over 100 seconds to load to log a result that way. The programming is straight forward and doesn't work any other way. I think you're having an issue during those times or your bandwidth is in use... that would definitely cause that to happen. Like if you're downloading something, then the auto test pops off... the end test result will be minus the speed of any transfers in process. If you do find for some reason that you have issues with the 256 kB test you can always manually select your test size. Selecting 'nfw' checkbox on the Auto test will force it to not forward you... there are still some minimum requirements. Certain circumstances will always force a forward to a larger test. Sorry for just replying. Was away from computer. So as per your recommendation, I am doing an autotest with these parameters: Test: Combined Every: hour Repeat: 24 Min DL: 5MB Min UL: 5MB nfw: Yes Results of first go (1 of 24): Sat Oct 31 2015 @ 1:16:03 pm PH 5 MB 4.66 Mbps 583 kB/s Gio Bacareza 4506914847577 YNVT8Wq9i Sat Oct 31 2015 @ 1:15:23 pm PH 384 kB 444 Kbps 56 kB/s 450689724005 AUsCKebGD Sat Oct 31 2015 @ 1:15:13 pm PH 5 MB 1.04 Mbps 131 kB/s Gio Bacareza 4506914847577 spZLoqhfA Sat Oct 31 2015 @ 1:14:52 pm PH 256 kB 164 Kbps 21 kB/s 450689724005 ETK0U9mqW Sat Oct 31 2015 @ 1:14:42 pm PH 672 kB 411 Kbps 51 kB/s 450688527172 iTzebcQIn :::.. Internet Speed Test Result Details ..::: Download Connection Speed:: 1032 Kbps or 1 Mbps Download Speed Test Size:: 5 MB or 5120 kB or 5242880 bytes Download Binary File Transfer Speed:: 129 kB/s Upload Connection Speed:: 4664 Kbps or 4.7 Mbps Upload Speed Test Size:: 5 MB or 5120 kB or 5242880 bytes Upload Binary File Transfer Speed:: 583 kB/s Timed:: Download: 40.661 seconds | Upload: 8.994 seconds Tested At:: http://TestMy.net Test Time:: 2015-10-31 13:16:03 Local Time Client Location:: PH https://testmy.net/country/ph Target:: Hong Kong, CN http://cn.testmy.net Validation:: https://testmy.net/db/spZLoqhfA.YNVT8Wq9i TiP Measurement Summary (Download):: Min 0.65 Mbps | Middle Avg 1.1 Mbps | Max 2.04 Mbps | 103% Variance TiP Data Points:: 1.63 Mbps, 0.66 Mbps, 0.65 Mbps, 1.48 Mbps, 1.36 Mbps, 1.46 Mbps, 2.04 Mbps, 1.26 Mbps, 0.98 Mbps, 1.21 Mbps, 1.12 Mbps, 1 Mbps, 1.05 Mbps, 0.78 Mbps, 0.69 Mbps, 0.85 Mbps, 1 Mbps, 1.07 Mbps, 1.18 Mbps Client Stats:: https://testmy.net/quickstats/Gio%20Bacareza https://testmy.net/compID/4506914847577 User Agent:: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/46.0.2490.80 Safari/537.36 [!] QUESTION: Why does the table show multiple tests with multiple sizes even when (a) I have set nfw and (b) text results show tests size to be 5MB and consistent with parameters? Thanks PS. Will post table results after 24 hours. Link to comment Share on other sites More sharing options...
CA3LE Posted October 31, 2015 CID Share Posted October 31, 2015 Your bandwidth to China appears to be degraded. Switch to Dallas or California. Also change the minimum to 10 MB download no minimum upload. We'll let the upload auto resize. You first want to be selected on the server that's giving you a favorable result. If you're getting better results against a server that's further away... you should definitely test against the further server. Unless your goal is to to test to mainland China because you visit a lot of sites or servers hosted there. The servers in California are about 3 times further away from you but you're getting better results from there. Traffic to China could be slower for a number of reasons. Part of which may be the government. Do an extended test against China as well, it's good information to know. I just think that for the test you're really trying to conduct, it may be better to test against the server that you've been able to achieve the highest results from. Link to comment Share on other sites More sharing options...
CA3LE Posted October 31, 2015 CID Share Posted October 31, 2015 Of course soon after you post two runs that look like this. https://testmy.net/db/AD90ymY3t.LUYSDX16n ... that's more like it. But the hours when your slow, you're really slow. Link to comment Share on other sites More sharing options...
Gio Bacareza Posted November 1, 2015 Author CID Share Posted November 1, 2015 Thank you. I will implement your recommendations but I have a couple of questions/comments: Quote "Your bandwidth to China appears to be degraded. Switch to Dallas or California..." and "You first want to be selected on the server that's giving you a favorable result. If you're getting better results against a server that's further away... you should definitely test against the further server. Unless your goal is to to test to mainland China because you visit a lot of sites or servers hosted there. The servers in California are about 3 times further away from you but you're getting better results from there. Traffic to China could be slower for a number of reasons. Part of which may be the government." I was only doing this because of your earlier recommendation to change my servers to china for where it was originally which was calfornia. My aim is not to test to mainland China but to make my ISP honest. So whichever server it is that would reflect this which I assume to be where my normal traffic is then I'll use that server. Am I correct in this assumption? Quote Also change the minimum to 10 MB download no minimum upload. We'll let the upload auto resize. If I do autotest on both DL and UL, I can set minimums on each but I can only set NFW on both. So do you mean to set DL min size = 10MB, UL min size = not specified and NFW = YES? As promised, sharing with you my analysis on the results of the recently concluded test run from 10/31 to 11/1/2015. The interesting findings are: 1. Opposite to what I experienced before, this test run showed that DL tests with smaller sizes (average of 140MB) shot up to 42Mbps (which is way beyond ISP speed for my plan of 20Mbps) compared to 256MB/20Kbps before. Interesting. You can see a rough correlation here. (https://www.evernote.com/l/AAngLKFM6wBNII4wWIY2JWqES3f7OHwztqM) Why is this? 2. Why is it that despite setting size = 5MB, TMN still tests at these smaller sizes? 3. The other interesting result is that UL was the opposite to DL: The smaller the size the slower the speeds. https://www.evernote.com/l/AAkZT4eKtQBHJ5RGBzBq8F_pGy3DsK5eEdM. Why is this? Anyways, use those results whereever it is applicable. I will do another 24 hour run with your new recommendations and share results as per usual when done. Thanks! Link to comment Share on other sites More sharing options...
CA3LE Posted November 1, 2015 CID Share Posted November 1, 2015 Here's your Hong Kong results for other people reading this. https://testmy.net/stats/?&t=u&d=11012015&x=1&l=100&z=66&q=Gio Bacareza Your link is only 20 Mbps? You were getting nearly 50 Mbps for about 7 hours. https://testmy.net/db/AD90ymY3t Nice and steady, looks legit to me. Knowing how TMN works and it's random nature, especially in the linear test you performed, I trust those results 100%. Somehow, you were faster during that period. At least to Hong Kong. 10 hours ago, Gio Bacareza said: If I do autotest on both DL and UL, I can set minimums on each but I can only set NFW on both. So do you mean to set DL min size = 10MB, UL min size = not specified and NFW = YES? You can only select NFW for both but when you don't select a minimum size for upload it will auto size the test. I can see where NFW needs improvement in that situation, I'll make sure that gets an update soon. Link to comment Share on other sites More sharing options...
Gio Bacareza Posted November 2, 2015 Author CID Share Posted November 2, 2015 Quote I trust those results 100%. I trust your results and I have to say that I'm so grateful for this tool. It is the most comprehensive tool out there. The problem is the Telco (or ISP). They will always point out to some other reason but not them when there's degradation of speeds or when they are not giving the speeds that they have marketed and what customers are paying for. It's the main reason I'm trying to understand how TMN works (I'm just a noobie right now.) The clearer I can explain to them the results and the more variables we can put as "control" the less reasons they will have to point the finger to something else. Good work guys! And thanks for the patience as I try to understand TMN. As promised, I will update this post with the results of the latest 24-hour run which should finish in 5 hours. CA3LE 1 Link to comment Share on other sites More sharing options...
Gio Bacareza Posted November 3, 2015 Author CID Share Posted November 3, 2015 As promised, here are the results at 10MB DL, Servers = San Francisco https://testmy.net/stats/?&t=u&d=11032015&x=2&l=100&q=Gio Bacareza It's a dismal 1.4Mbps average on a published rate of 20Mbps Link to comment Share on other sites More sharing options...
Gio Bacareza Posted November 4, 2015 Author CID Share Posted November 4, 2015 My ISP told me they only guarantee "local loop." Is there a way I can test the "local loop" using TMN? Link to comment Share on other sites More sharing options...
CA3LE Posted November 4, 2015 CID Share Posted November 4, 2015 Do you have access to a larger image on their server? Try these Mercury tests. pldt.com smart.com.ph I just created the pldt.com test. Used http://tools.pingdom.com to parse http://pldt.com for an image at least 120kB (seems to be a good all around size). Then go to https://testmy.net/mercury and paste the image URL. TestMy.net will make a test out of the source image, so now you have a test that's testing against an image that's actually on one of their servers. After creating that test it showed me another one that someone else had already created. Right now you can't set those tests as default so you can't use them with the auto test. If you really need to use it with the auto test right now I can take the time and make it work that way for you. It will take a few modifications. Keep in mind that the progress bar for Mercury tests is not always as fluid as the other tests here. The information will download as it would if it were loading on their website. Mercury tests are multithreaded and are limited to the output of the host server. When I test against those I get a fraction of my normal speed 1.7 Mbps (plot.com) and 9.9 Mbps (smart.com.ph) but if you're within that network you may see better speed. What use is it to you if they only guarantee speed within their network? You did order Internet service, right? Link to comment Share on other sites More sharing options...
Recommended Posts