@kimhoar big datacenters use dozens if not hundreds of megawatts of power, AFAIK there's no way to generate that much electricity onsite without resorting to things like nuclear reactors (is being looked into actually).
The COP (Coefficient Of Performance) with heatpumps ranges from about 2-4 in residential ones to about 5-6 for commercial ones such as used in datacenters. A COP of 6 means you need 1kw for every 6kw of heat you're moving, so even the most efficient ones require many megawatts.