Earlier estimates suggested that ChatGPT consumes around 3 watt-hours of power per query—ten times the average energy required for a Google Search. However, a new report from Epoch AI, a research institute analyzing AI trends, challenges these figures. The report suggests that OpenAI’s chatbot consumes significantly less energy than previously thought.
According to Epoch AI, ChatGPT, based on the GPT-4o model, uses only 0.3 watt-hours per response. Speaking to TechCrunch, data analyst Joshua Yu noted: “The energy consumption is actually not that high compared to using typical appliances, heating or cooling your home, or using your car.” He explained that earlier estimates were based on outdated assumptions, particularly the belief that OpenAI operates ChatGPT using older, less efficient hardware.
“In addition, some of my colleagues noted that the most widely used estimate of 3 Wh per query was based on fairly old studies. And judging by some rough calculations, this statistic seemed too high,” Yu added.
AI Advancements and Energy Demands
Despite these findings, the Epoch AI report does not provide a definitive answer regarding ChatGPT’s total energy use, as it does not account for features like image generation. While Yu does not expect ChatGPT’s power consumption to rise dramatically, he acknowledges that more advanced AI models will require increased energy to operate. AI leaders, including OpenAI, are developing reasoning-based models that not only answer questions but also explain their thought processes, requiring more computational power.
Recent reports have also highlighted the water consumption of AI technologies such as Microsoft Copilot and ChatGPT, adds NIXsolutions. The hardware running these systems uses the equivalent of a bottle of water for cooling per query. Previous research found that Microsoft and Google’s combined energy consumption surpasses that of more than 100 countries worldwide.
One study revealed that OpenAI’s GPT-3 model consumed four times more water than previously estimated, while GPT-4 uses up to three bottles of water to generate just 100 words. As AI models advance, they naturally require more resources. Yet, the latest findings indicate that ChatGPT may not be as energy-intensive as once believed. We’ll keep you updated as more studies shed light on AI’s resource consumption.