alrighty first the idea of this wasn't mine I saw MrMax2012 posting this and I wanted to ask you all about this...
Don't ypu think that most of Konoha would of known Naruto was the son of the 4th Hokage due to his mum being an Uzumaki and being the only Uzumaki in the village, and being married for Minato, it pretty damn easy to notice but magically only the Kakashi guessed and the 3rd of course knew aswell including the elders.