He had them at some point in his life; but there is a high chance that he might be orphaned amybe during a war or nine tails' attack or something like that.
But this panel kinda shows that he had nobody; the fact that he did not mention about his parents' effect seems weird; and there must be a reason why Gai is like a father to him.