Last manga chapter showed us exactly why Boruto threw away taijutsu to turn into a kenjutsu adept.
He got owned in Taijutsu by Sarada (without Sharingan), with Mitsuki having to interfere in the fight:
Right in this very moment, he knew it:
Then, later on, he picks up a sword:
Coincidence?