I wonder how phone size, battery placement, and materials play into this.
Being able to dissipate more heat while charging will help significantly too.
I've had a phone with a ceramic back that would die in minutes in cold weather if I didn't keep it in my internal coat pocket. It charged much faster than another phone that had a plastic back with a similar battery size and charging capability, even using "slow" charging (using a lower power charger). I can only assume the heat dissipation made a difference as the ceramic one never got even very warm while the plastic one did.
So maybe a combination of everything mentioned here - charge control in the phone, how the controller manages cells, location of battery in phone/heat dissipation, power optimizing while charging (do all of these phones support pass-through? That would influence charge time), etc.