It’s not just a fat or muscle thing. Those both contribute of course; fat insulates and muscle produces more heat. But the real player is the surface area to volume ratio.
A bigger person has a lot more volume than they have a bigger surface area, and since heat is lost through the skin this has a major impact.