I dont watch one piece but that only shows durability to physical trauma meaning elements like Lava can hurt him. Actually that durability isnt all that impressive. After a certain point he would have reached terminal velocity and the force that force would have been constant. In fact people have done this in real life by landing in stuff like snow, they were extremely lucky though. Id say people like Ay and such would have no problem harming him.