I have noticed, that though they don't look it, the elders seem to be individually very strong shenobi. (Examples include danzo, chiyo). If all elders were at that level, how much pwnage could they inflict upon the world?
