Perhaps Sasuke and Hagoromo decided to plan something evil during their meeting & conversation (which we didn't get to fully see) and now the time has come to fulfil that plan since Kaguya is defeated (a character they must first deal with since she might ruin their plan), and so Sasuke is just regretting that decision?
Nah, this sounds too far-fetched Lol