Yep, he didn't go to Kaguya's dimension even though he abandoned his family. He waited to just before the Chunin exam or the Gaiden arc, so yeah he abandoned his family. Then he comes back during the chunin exams and is riding Burrito, the guy lretty much stans him all the way through, even taking him to fight Momoshiki. And during his time back, he doesn't even bother training his own daughter. So yeah that's his purpose in the story, even now he decides to use Burrito against Isshiki because..
This isn't part 1 or part 2 Sasuke, this is part 3 Sasuke. Who will even give up his sword, headband and cape to Burrito. He's probably dead at that point, but this is what your boy's been reduced to.