>5ms over 20 hops leads to 100ms, which is bad for interactive uses such as multiplayer gaming (where you ideally want 5-10ms end-to-end roundtrip).
People seem to play multiplayer games over residential internet connections, where the end-to-end RTT simply cannot be below 30-40ms, and longer is common (15-20ms ping to the first hop is pretty much the best case scenario).
I don't know how you're achieving 5-10ms RTT (although I would be interested - leased line? FTTP?), but it's not representative of the vast majority of connections used for gaming.