I wouldnt agree..the only reason he is as good as he is with taijustu is because he spent all his training time focusing on just that...if it was spread out with ninjutsu training too then he wouldent be as good as he is now.
That and his particular brand of his Will of Fire, which Gai and him share. The thing about the gates is that they do massive amounts of self-inflicted damage, which requires equally amounts of massive training to accommodate that. Learning how to open them is just half the trick, the other half is surviving the damage one inflicts on themselves (recall Gai after battling Kisame w/ 7 gates and Naruto just barely touched him?...caused massive pain), which is the majority of the training. Kakashi called Lee a genius for being able to open the 5 gates through sheer will power alone at the Chuunin preliminary exams against Gaara, so Lee's taijutsu is something he's naturally gifted at, not to mention his drunken style, which we never get to see...
I agree you take away that training time for the gates and dedicate it to molding chakra and ninjutsu, and he then limits/retards what makes him special, his taijutsu and his inner gates, which makes no sense. Only someone that's seemingly "inhuman" as Naruto has a chance to make this work because of naturally massive chakra reserves and Kurama's chakra so that they could do shadow clone training to make up for years of training in only weeks-to-months. Lee doesn't have that. I predict that he'll surpass his sensei, Gai, an elite jounin who's a friendly rival to Kakashi (Hokage candidate), not bad for someone who only knows taijutsu. I guess he's gone a long ways with his nindo...
Peace