You're patently incorrect. Human Path has very impressive taijutsu to be able to fend off Jiraiya. Even Jiraiya pointed out that his own taijutsu was useless even while in sage mode. Everyone who can read, this may exclude you I understand, knows that Nagato has taijutsu. The only doubt is how good it actually is. This is open to several questions that we need to consider.
1) In terms of taijutsu, how capable is a healthy Nagato to Human Path?
2) While Nagato knows taijutsu, is he a taijutsu specialist or has he focused primarily on ninjutsu?
3) What role, if any, does the Rinnegan play in taijutsu mastery?