I think Hagoromo had the yang seal because he embodied both. Although he had a Sharingan he was also a sage and jinchuriki two abilities that are considered high on the yang scale. Since Kaguya was basically the ten tails her sons may have inherited the yin and yang. She had plenty for everyone.