I was always taught that it had to do with surface area. If two skydivers were shaped exactly the same, but one weighed 100 more pounds than the other, wouldn't they fall at the same speed?
I thought that's what was proven at the leaning tower? He dropped two balls, same shape, one heavier than the other, and they hit the ground at the same time.