Everyone with a Kekkei Genkai would have to be related to Kaguya as she is the essential origin of Kekkei Genkai. It's extremely doubtful that the same Kekkei Genkai spawned in random in later years.
That is highly suspect though, and we don't have enough information.
Sharinnegan and Mokuton, chakra and elements, clearly came from Shinju.
Kaguya may had been an alien with the Byakugan and perhaps bone release.
Kaguya ate the Shinju's fruit and gained it's powers.
Hagoromo, her oldest son, seemed to have inherited the Sharinnegan and Mokuton. He has not displayed Kaguya's innate abilities.
Her younger son, Hamura, seemed to have only gained her innate abilities and was, like Hagoromo, born with chakra.
None of their direct decedents have displayed any elemental kekkei genkai except for Mokuton.
It's still speculatory on where people gained their elemental kekkei genkais from. The Bijuus seem to possess those kekkei genkai and pass it onto their human hosts, which becomes part of their genetics. A problem is that, as far as we know, people didn't start making Jinchuurikis until around 50 years ago.