Minato is considered a genius, he is smart enough to know that anyone + Madara = anyone dead, quite simple (Hashi is d only exception). Ciao.