I agree with you completely, but I think there's a subtle misunderstanding here.
I think what the OP is trying to praise is Lee's normal speed, i.e., no gates or chakra.
Lee always has his weights on. Even now during the war he has them on. Hence, he is always handicapping his speed. When he took off his weights, that was his normal speed. He wasn't using any gates or using chakra. He was essentially just running and jumping around.
Now, when compared to Naruto's and Bee's cloak, A's Lightning Armor, etc., this speed is negligible in comparison, but in terms of speed without chakra augmentation of any kind (a.k.a., running), Lee (and Gai for that matter) most probably rank near the top.