The Main reason he will lose is due to him being slower, As stated in part 1, You need a high speed combo to break Neji's defense or some ridiculously overpowered jutsu, Kabuto lacks both.
As i said he barely kept up with a rusty tsunade, How he will even land a blow on a Taijutsu expert with almost 360 vision and the ability to sense incoming attacks before they even reach him, i don't know.
There are far more chances of Neji hitting kabuto, then kabuto hitting Neji. Neji is simply a bad match up for kabuto.
