Hagoromo speaks to all Transmigrants, as per Black Zetsu, but judging by Hashirama's reaction when he saw the Sage, we can assume that he didn't talk to the both of them.
Black Zetsu never said that Hagoromo talked to all transmigrant. Rather he clearly said that
<< depending on the power of the transmigrant, Hagoromo can meet them to give them the technique to seal his mother>>. Here, you need to understand that the transmigrant need to be special, and in our case, when hagoromo met Naruto, he even mentioned that Naruto has a special power that made Ashura choose him as his reincarnate, and that special power summoned his soul (Hagoromo's soul).
So yeah, it was Naruto who summoned hagoromo's soul in the current situation. Everything that happened later happened because hagoromo's soul was already summoned by naruto when he was in the world inside his mind.
I even bet Sasuke met hagoromo because Hagoromo was already summoned by Naruto, and we can see that by both Sasuke and Naruto meeting inside Naruto to receive powers.
Consequently, if we don't want to put blame on Kishi and actually read the manga, a lot of things are consistent. The only mystery here is how Naruto summoned Hagoromo's soul?