Just because they don't wear pads doesn't mean it's rougher. In Football, they hit way harder and are more athletic. In fact, there are probably more concussions in football and some football players even gain brain problems.I actually believe he was referring to "American Football"..
Either way he was wrong, Rugby is by far the roughest sport there, and even that is like girls play to boxers.