I think they were wiped out because of the same reason that Haku's clan was wiped out. They were their own independent village and they were widely feared. Not to mention many villages were after them for their abilities and bodies. This only strengthens the fact that the Sage was their ancestor.sorry , thats what I meant to say....