Imo I would say age matters, but size doesn't
I don't think kaido would be bigger than sengoku if he had eaten the Buddha fruit. I think they would be the same sized buddhas. That's why I don't think size of the person matters
But I would find it hard to believe Momo's dragon won't grow as he...