Doffy got assistance from Bellamy and Trebol, and Bellamy was able to separate Luffy and Las for a while since Luffy didn't want to beat up Bellamy. Bellamy also did some damage to Luffy and made him waste Haki. Trebol helped Doffy by distracting Law. Doffy only gave Luffy and Law a lot of trouble since they didn't fight him together for almost all of the fight. If Doffy didn't have any help, which would allow for Luffy and Law to fight together the entire time, then I think Doffy would get mid diffed.