For now, it suits our purposes.
*When you come at me, your blade raised, I quickly swing my blade from right to left in an upward arc, holding the blade with only my left hand, while I sidestep to my right - this allows me to push your blade to my left, while also moving away from your blade; since I deflected your blade instead of stopping it, your strike comes down to my side, missing me.
However, as I'm doing this, I quickly step in an extend my right arm, jabbing at your ribcage, just below your right shoulder, as your blade comes down, shortly after it passes above waist level for you. I hold my blow before actually connecting the strike.*
See, something like that. Taijutsu moves add another dimension to a Kenjutsu attack, adding elements that otherwise may not be drawn upon. There's a myraid of different fighting styles, and a great number of them can be paired well with Kenjutsu - it's all a matter of what works for you.
For example, I'm a grappler, for the most part. I like to do throws, palm thrusts, and jabs, rather than full blown uppercuts, etc.
However, another person may favor a flourishing, airborne style, relying on kicks. And it's very possible to make something like that work. You really need to experiment, and find what you like best.