Thank you and sorry about the late reply, but it turns out, it's my fault and I wasn't aware that would happen, as it was my first and last time ever doing the Windows insider program. My pc is still stuck, I finally got past the last update that was keeping me from connecting to the net and now I'm stuck on the next update. Oh well, at least I know it's not the game.
By the looks of your recent tests, it would appear there are other types of games going on there.
I would suggest there is heavy download / upload activity, which could then suggest that when you yourself see slowdowns and disconnects or time out issues, someone is torrenting data at that time. ( In other words, downloading and then sharing files / data publicly )
As normal gaming would most likely not consume ~5Mbps upload , nor effect any normal web browsing on another machine, at the speeds your connection is showing.
I would also suggest he knows quite a bit more than you think.