like you said, it might be the distance
but also serverload, server TCP settings will affect your speed
also how large testfiles that the test using
i score around 3 Mbps up and down on that Speakeasy test and around 26 Mbps down and 1.6 Mbps up against Testmy.net, even tho my route is better to Speakeasy test server.
Before testmy.net server was tweaked, i scored around 3.7 Mbps down so server tweaks does help alot
VanBuren