A phobia is an irrational fear, if it's rational it shouldn't be classed as a phobia. Not referring to Islam, I mean in general.
Anyway, Isms are neither right nor wrong, they indicate states. If one doesn't fit the state then it shouldn't be applied to that person. I mean humans in general...