Jump to content


  • Content Count

  • Joined

  • Last visited

  • Speed Test

    My Results
  • Days Won


Everything posted by CA3LE

  1. It kept crashing, at first it wasn't crashing tables but toward the end it was doing it every time. Everything has been migrated over to a new server. It feels correct now. Sorry it took longer than it should have, I tried a direct copy of the mysql directory, which would have been faster but after starting mysql it kept having speed issues, as if it had no indexes. Multiple attempts to repair and then I gave up and did it the slow, reliable way. mysqldump and import. This new MariaDB (mysql) server is only doing that one purpose for just the master databases. The forum is on a different server... I think that helped a lot this time. The forum is heavily integrated, it's integration can be toggled on and off but it's not ideal for me to do that. Having the forum database on a different server minimized downtime and left this line of communication open. Before the server running MariaDB had other tasks to deal with. Not that it couldn't handle it... what I feel like it did is overcomplicated the ground floor to the point that it made it hard to determine the source of this issue. Many different software packages updating... complicates things. Sure, you can dig into logs and eventually fix it... but I feel at that point it's time to refresh and learn from mistakes. So this server is running a super simple MariaDB only install. Please let me know if you see anything out of place or not working.
  2. Actually, it was 5 indexes on that table. On to ResultDetails... [[email protected] tmn_scores]# myisamchk -r Master - recovering (with sort) MyISAM-table 'Master' Data records: 0 - Fixing index 1 - Fixing index 2 - Fixing index 3 - Fixing index 4 - Fixing index 5 Data records: 151885140 [[email protected] tmn_scores]# cd ../ [[email protected] mysql]# cd tmn_scoresXI [[email protected] tmn_scoresXI]# myisamchk -r ResultDetails - recovering (with sort) MyISAM-table 'ResultDetails' Data records: 120457254 - Fixing index 1 70010000
  3. No problem, it happens. Until I figure out a better system for storing data.... this is what happens. Every so often I get headaches like this but it reminds me why I do this. It also teaches me to do it better. Because to be honest, this SUPER embarrasses me. Any form of downtime is unacceptable. That pushes me to make TMN more reliable for you. First thing I want to share is https://status.testmy.net/ -- I will be continuing to add more monitors of different types here. This is monitored by a third party (as it needs to be) UptimeRobot. They are not a sponsor, they may not even know of TMN. In fact, I just paid them... I was just looking for a pingdom alternative and liked them so much I paid for a year right away. Pingdom is great by the way, I just want something more simple , that does the job for less money... that's how I do it. I like them enough to not hide their logo on that stats page, even though they offer me that ability. Second, I found that the Master database server is running on half memory. I had a crash a few months ago that prompted me to build a new server. I feel like any crash is a time to build a new server... once I build one, it normally runs without reboot... until I want to replace it. When it crashed, it didn't want to come back online. I was frantic and completely forgot about my IPMI controls... but Carl at Data102 quick ran from the 2nd floor to the 12th floor and got to my console. Gave an error about memory missing. He hard rebooted and it was online since. What I never realized until today when I rebooted... it's not registering memory on a slot I know has memory in it. P1-DIMMA1 should be present. Sigh. On thing people may not realize when they visit here is that this is built by a dude in his basement. They also might not realize that the same dude has to built the systems that run the site, down to the individual hardware components. I had a cloud hosting company offer me (I'm not joking) "$50,000 per month of services for 6 months... just try us out!" -- a large, reputable company that I use for my mirrors. They aren't joking. But I don't want to go down that rabbit hole. For the resources I'm comfortable running.... they don't even offer packages. I scroll down the page, get to the end and it's a ridiculous price. I'm like, "yeah right, I'll buy my hardware and build it up." Okay, so I ordered more memory. I'm upgrading the slave while I'm at it. I can't get my v2 architecture on the server I just built to perform as well as the v3 and v4 in the beasts I already have running. The server I just built is 20 core, 40 thread... it's faster in some workloads but for what I need it for, it can't compete. Even my slave server is 2X faster in mysql queries. And it's an ant compared to the master server. The slave server is even right on par with the master in the same queries... but Mistress falls behind. 2X slower. We can't have that, even as a backup. So Mistress will have to be a backup of a backup... forever. I feel now, it's time to bring the slave up to the master's standard. I only have an E5-2603 v3 with 16GB non-ECC and 1 256 GB EVO PRO. I ordered an E5-2630 v4, 32 GB Crucial 2400 ECC and I already have 3 256GB EVO 850 PRO's on hand ... add to the other one to build a new RAID-Z2 array. Also ordered a new 16GB Crucial 2133 ECC to replace the one that may have died. I may find that the slot died, who knows until I get in there. So the slave will pick up a larger redundant storage array, 32 GB of buffered memory (instead of 16GB unbuffered) and 10 more processing threads (up from 6). Less threads than the Master and the Master also has redundant power... so it will always be the Master until I get something more powerful with redundant power. (datacenter's needs to do routine maintenance sometimes, if you're on A/B power they'll turn off A... work.. then turn off B. Server sounds an alarm but keeps running. I maintained service and data integrity 100% during that type of maintenance before. It's worth having just for that, not to mention a power supply failure.) ... the 32GB 2400 MT/s memory will go in the Master, the 2133 goes in the slave. So I'll have to make sure everything is pushed to the Master, take down the slave... open it up and take out the non-ECC RAM, put in the new stick of 2133 I just ordered (and CPU/SSDs). Bring it back online, push everything to the slave... take down the Master... install the 2400 sticks... bring the Master back up.. take down the slave and rebuild it from scratch. 100% new software setup. The server I just recently built still comes into play... it's the backup while the backup is offline. --- then the slave goes back online... Master comes down, it gets The Royal Treatment. Ready to come back online and remind you that the backup server by comparison, is still a backup server. It can be fixed a few different ways. My favorite way is to start from scratch. Fresh kernel, fresh install... and while you're at it, fix any short comings. I feel like the CPU power on the slave CAN'T keep up with TMN... the Master with an E5-2640 v4 has a hard time with many tasks, but the E5-2603 v3 is like 10X slower. It would take many days to import the main databases for TMN on the slave, still takes at least 12 hours on the Master... but much better than MANY days. Second shortcoming, it needs ECC RAM. It's the only server I have without this. Third, it needs a RAID-4 or RAID-Z2 array. It's the only server I have without this. If that stick of memory is bad... according to Crucial it will be covered under warrantee. I'll update this thread with the RMA later. Memory and CPU's are expensive right now. The CPU and memory I'm replacing are selling used for > 2X what I paid for them in 2016! That's a win... but the parts I need to buy cost 2X more also. 😕 --- screw all of your investments in 2016... you should have bought Xeon's and high end server RAM and put them in a box, lol, no joke. Double your money, are you kidding me!? nice. ... me and my stupid bitcoins over here. (obviously kidding, bitcoin is far from stupid, e.g. the year 2021) Site may crash around 5:45-6am ... I'll be waiting. If it doesn't we'll hopefully be good until my hardware comes in from Amazon. -- after I've installed the hardware we're looking at up to a 24 hour window of instability. The slave server should minimize any downtime but a lot is going on during that window. Fingers crossed it all goes smoothly. BOOM, CRASH! Using the slave DB. I'm rebuilding the Master database again, sorry guys. Probably have to rebuild ResultDetails database after that too, usually if one of those crashes they both do... but not always. I might have to push the master databases over to the Mistress server. We're talking 0.16 sec vs 0.30 sec for the same query. Not a huge deal. I'm telling you... for this to happen with this frequency, something is majorly wrong with this mysql server. [[email protected] tmn_scores]# myisamchk -r Master - recovering (with sort) MyISAM-table 'Master' Data records: 0 - Fixing index 1 128840000 That's 1 of 6 indexes, that will take a little time. - Fixing index 1 144940000 pretty fast though. Just in the time I typed that. I remember this taking forever years ago. [[email protected] tmn_scores]# myisamchk -r Master - recovering (with sort) MyISAM-table 'Master' Data records: 0 - Fixing index 1 151880000 I'll get us back where we should be. Any results you log right now (while we're on the backup database) may not show in the original database but I'll import them later. I need sleep once the time comes but it's going to be nearly impossible right now. On index 3 now... -D
  4. No problem. Just crashed again briefly... this time is was the database server that runs the forum database. I'll start resetting these services on a schedule every few weeks. Hopefully that will help avoid this a little more in the future.
  5. We're running back on the master. I need to import results from yesterday from my backup database over to the master, for now you'll be missing the last 24 hours of results. I should be able to take care of that this evening. Sorry again about any inconvenience. Please let me know if you see any residual errors.
  6. CA3LE

    other peoples results

    Today's issue has to deal with a database crash. Nothing has been lost, your previous results will be back online as soon as I've migrated data to a healthy server. ... I then need to migrate your results back from today. So those may disappear briefly once the other results return. The issue of seeing other's result's, I'll closer at that as soon as we're fully back up.
  7. CA3LE

    Is my Internet speed accurate?

    No, not at all. You just have to think about who wrote it, Vimeo's technical department, they're IT dudes like we are. They don't have any horse in the game so they really just want to help people and get them to get the right answer. The people who I'd think were in an alternate universe (at this point... didn't used to be this way) if they said that... internet service providers. Nearly all of them. I hope one day that changes. I hope one day that they're delivering service so outstanding and they're so confident in its performance that they purposely refer people to the most difficult internet speed test... instead of ones that favor them / make efforts to give users the best chance to score high. But like I said before in this forum, until then... I'm more than happy with the >1% who get it.
  8. CA3LE

    Is my Internet speed accurate?

    @Fredor5 Is this where you found TestMy.net? https://vimeo.zendesk.com/hc/en-us/articles/224968848-Playback-quality-and-buffering-issues Thank you for the link Vimeo! Cool, there's more.
  9. CA3LE

    Is my Internet speed accurate?

    Now that's what we like to hear!! 978593978134's Speed Test Results (results prior to signing up) Thank you for sharing that. What was the issue that was slowing you down so much? Just totally their end? ... did you feel like all it took was a complaint and they were like, "Turn him up, he knows!"
  10. CA3LE

    14 years...

    Glad to see you back! That was rare... now we have it in our pockets. Insane. Not like it was... I feel like since social media gave people other outlets, forums in general across the internet aren't poppin' like they used to be. I'm sure the largest forums are still highly active but probably not at the same levels of participation. The vast majority of people who visit TestMy.net just use the speed test, probably never realizing there's a forum at all. Sites back in the day that primarily focused on forums may have done better when times changed... for TMN, forums were never my focus. They're used more for support and getting feedback from my users. I watched the forum portion of my traffic dwindle over the years but the main draw of TMN (speed test) became more popular than ever. An open beta for TMN will be coming soon btw. Last major redesign was in late 2012. I have a long list of tweaks and touchups to do before release but it's on the way.
  11. CA3LE

    Where Do You Live?

    Add yourself to our new frappr map [LINK REMOVED ... Site no longer exists] just a fun way to see where our members live, will also give you an idea how close you are to the test server. - Damon
  12. CA3LE

    LAN/WAN test

    Sorry I don't have any LAN tests available. I highly recommend using iPerf (download iPerf) to test internally. Freeware and very accurate. Here's some instructions. Check the video description for more details and copy and paste commands. Let me know if this helps.
  13. CA3LE

    Test my net

    Done. 154060381465's Speed Test Results
  14. CA3LE

    Won't stay signed in tonight...

    Hey Gabe, I primarily use Chrome myself and haven't had any issues on any of my machines. I would reset Chrome settings to default. There may be an extension or something causing issues. If you try that let me know if it helps.
  15. CA3LE

    test not accurate

    Great to hear! Thanks for replying back. Awesome your connection is running back where you expect to see it.
  16. CA3LE

    Auto test not running

  17. CA3LE

    Time zone options for TMN

    Are you still having this issue? If you clear your browser cookies it will force reset your timezone. It's supposed to update that automatically. It's showing the correct time for me and I also have DST. I'll look at the code in case there's a mistake.
  18. CA3LE

    Auto test not running

    Not right now but I think I can make some modifications to make it work the way you need. I actually already took a note to look into that after your first post. Give me a little while to mess around with it and I'll get back to this thread soon.
  19. CA3LE

    Auto test not running

    If your computer was put to sleep overnight and then you turned it back on this morning the timing mechanism was paused while your computer was asleep. Try running an auto test on a lower interval (like 15 minutes) so you can get a feel for how it runs. Then turn it up to your desired 12 hour interval... just make sure your computer is set to stay awake. The display and drives can sleep, screensaver is fine... the browser window doesn't even need to be in focus or visible. But if the computer goes to sleep or hibernation... the auto test won't work. Here's instructions from Western Digital on how to change those settings. This is the first thing I change on a new computer. Looks like you're running Windows 10... https://support.wdc.com/knowledgebase/answer.aspx?ID=3875#win10 If you're using a laptop make sure you're plugged in during testing and change the power management settings back when you're done otherwise your battery will drain quicker. Let me know if this helps.
  20. CA3LE

    Auto test not running

    First, thank you. Is it possible that your computer fell asleep? Make sure you change your power management settings to keep your computer awake during the test.
  21. CA3LE

    Slow internet

    ... you should see my email. I have dozens, maybe hundreds of these. I usually just ignore them. When I do respond, they never respond back. This is a quick search of my inbox for "internet slow" ... these are recent, within the last month. And this is only the ones caught by those specific keywords. lol Gotta love this one... "I want my internet fixed it's slow!" -- talk about shooting the messenger. Often they're far more rude than that. ... the last one caught my eye... Awwww man! That was just a nice guy who wanted my help. His email got caught up with the others. I'm sorry Harsh! [emailed him just now and shared this topic] I don't know why some people always think that I have some control over their speed. If I did, everyone would be at least as fast as I am! I also get angry people wanting me to fix their bills. Again, if I had control over that, your bill would be $0.
  22. Please let us know how the new ISP looks. Thank you for sharing your experience!
  23. CA3LE

    test not accurate

    I see some of your recent results with a middle and average closer to what you're hoping to see. But like my connection, you're starting out slow. At 20-25% you hit your stride. TestMy.net Test ID : 88v317QzK TestMy.net Test ID : V5TpK6VZW
  24. CA3LE

    test not accurate

    TestMy.net is hard. Keep reading. Hubcity is getting 90 Mbps with multithread. (btw @HubCity I noticed the two erroneous results that happened on your account when you switched multithread back on for the first time in a long time... the program should have removed a couple of servers from your selection that were no longer valid. This has been corrected for the future and those results were removed from the DB. Looks like you fixed it by going to the selection and selecting valid servers.) HubCity's Speed Test Results @missmoondog if you select a single server from the multithread test you may get better results. I do. ISPs are shaping how you are able to draw your bandwidth more now. I watched it happen to my own connection recently when I "upgraded" to "gigabit". My connection on the normal, default TestMy.net speed test actually scores much worse now. The connection is so slow to start building up speed it ruins the final result. That's TMN for ya! It's harsh. Even on the guy who designed it. I multithread and get a much better result. When I multithread to a single location, near by... I BLOW IT OUT OF THE WATER! Goes from 200 Mbps to nearly 500 Mbps. In line with results I see on ookla tests that Comcast pushes me to use. The ISP's want you to see the best possible outcome. TMN wants to help improve your speeds. I know it's confusing, I'm working to make a test to help illustrate the difference by testing all of this at once for you. Before calling Comcast my results between TestMy.net's two test types were basically the same. After upgrading and switching to a newer modem I now have a huge difference. Multithread off to Dallas Multithread on to Dallas Multithread off to Colorado (closest to me) Multithread on to CO My speed is not consistent like it used to be. Before the upgrade Multithread off to Dallas Multithread on to Dallas Here's two taken within seconds of each other, just days before I changed my package and equipment. Nothing changed with TestMy.net. Any changes are being built into the beta... In my case, my internet is to blame. It runs great and I can pull more bandwidth. I just can't burst it like I used to. And TMN, being harsh, shows that. I may be faster now once I get going but is that really faster when you have to wait for it to ramp up? Depends on how big your transfer is I guess. If you're on cable, I think the last great modem that (maybe) the ISPs weren't able to shape was the 8x4 channel Motorola SB6141. When modems with 16+ channels came out I noticed this speed curve and immediately went back to my SB6141. A couple of years later (just recently) I try to upgrade my package again and see the same slow start curve on TMN. This time I CAN'T go back. I tried to "downgrade" back to my original package and they cut my upload speed from 25 Mbps to 5 Mbps!!!! I spent over 12 hours on the phone with Comcast. Long story, I'll write about it later. Totally insane. Ended up with 35 Mbps upload. But my download speed isn't even close to being as stable in TMN tests as it used to be. I see this when I download from Giganews [usenet] (which can always max out my connection). Before I would start a transfer and it would instantly max out my connection... now I can get a higher speed but it takes time to build up, many seconds. Exactly in line with the results I see on TMN. Makes me feel bad when I test now but it is what it is. The methodology, test and servers didn't change... my connection did. Outside of TestMy.net every other speed test I've ever seen is designed to show your maximum speed. I personally don't like riding with blinders on.
  25. CA3LE

    Slow internet

    I got your messages too... I get messages like this almost daily. Please keep in mind, TestMy.net is a third party speed test and is not affiliated with your ISP. We're here to help you. Just like you I'm an average consumer. When I was 15 in 1996 I wanted to see how fast my internet speed was and I couldn't find a proper tool so I started to build what would become TestMy.net in 2002. I build TestMy.net so that people like us have a testing platform outside of ISP control. I'm sorry you're having ongoing issues with Hughes, it's a common theme around here. I rarely meet any satellite user who's truly happy. I assume where you live you have little options, right? Can you get a 4G connection yet? Maybe with the right equipment a cell connection might help. How much data are you transferring monthly?
Speed Test Version 15.9
© 2018 TestMy Net LLC - TestMy.net - Terms & Privacy