Yeah but Roger said it happened "countless times" meaning not just during the early days.The timeline of these fights are vague. It could be like Luffy vs Smoker. Smoker mopped the floor with Luffy at the beginning, but now Luffy stomps smoker.
And no, WB was said to be the strongest man alive after Roger’s death. Not Garp or anyone else. That alone says that Roger>WB>Garp