It's simply to easily to abuse. People could start organizing themselves just to get certain people banned, regardless whether they broke any rules or not. Saying that it needs to be a lot of dislikes isn't going to change anything about that as from the moment someone could potentially be banned by getting dislikes, it could be used for any kind of person, innocent or not.