The Leaf had his entire clan slaughtered, and would have killed him too if not for Itachi asking for him to be kept alive. He attacked the 5 Kage, but did not kill or seriously injure any of them. Hell, the Raikage probably would have beaten him. He helped defeat Shikaku when he was younger and...