Microsoft CEO says the company doesn't have enough electricity to install all the AI GPUs in its inventory

"So, if you can’t do that, you may actually have a bunch of chips sitting in inventory that I can’t plug in. In fact, that is my problem today. It’s not a supply issue of chips; it’s actually the fact that I don’t have warm shells to plug into." -- Satya Nadella

TLDR

Microsoft CEO Satya Nadella revealed that the company faces a significant challenge in the AI industry due to a shortage of power to accommodate all the GPUs in its inventory. Nadella emphasized that the issue is not an excess supply of compute but rather the lack of power to plug in the chips. This revelation highlights the growing concern over AI's power consumption and its impact on energy bills. Additionally, the discussion touched on the potential for advanced consumer hardware to reduce the need for large data centers, posing a risk to the current infrastructure investments.