Everyone was running out of chakra, so of course they would have a hard time against him.All I can say is...... I must admit kishimoto kind of messed up here.
4 Kages + Edo Hokage + Elite ninja couldn't bring that dude down..... 3 kids and a sanin did.. ok.
Karin went beserk and attacked it without thinking, that's why she did a lot of damage to it and that's when Suigetsu and Oro attacked, when spiral zetsu was distracted.