He was using Taijutsu at that time, he used Kenjutsu against Sasuke aloneStill not taijutsu. Fighting with swords is Kenjutsu.
They were all fighting and Killer Bee was using taijutsuThey were all using kenjutsu, we only see one panel of Bee punching Suigetsu and even then Suigetsu reacted to the punch before it landed.
And his Kenjutsu is a combination of Taijutsu and Kenjutsu, his Taijutsu is amazing