Garp stated it in Water 7 :sdo: when The StrawHats were surprised Ace's is not dragon's son :sdo; and Garp told them Luffy is my grandson and Dragon is his father. Secondly Sengoku always complains about Garp's entire family making trouble (Ace, Luffy Dragon)