An Introduction to AI’s Energy Demands and HPC Sustainability

This article has been adapted from the "Sustainable Computing for HPC and AI" eGuide.

Concerns about global warming and unsustainable levels of carbon dioxide (CO2) emissions loom large for organizations of all sizes. Manufacturers are under more pressure than ever to design energy-efficient products and move towards net zero emissions to meet corporate environmental, sustainability, and governance (ESG) goals. Virtually all organizations that operate large-scale data centers have similar concerns, from financial services firms to government agencies to pharmaceutical companies to online service providers. While high-performance computing (HPC) and artificial intelligence (AI) play key roles in designing and delivering more energy-efficient products, ironically, the widespread adoption of AI - with its enormous appetite for electricity - is driving dramatic increases in energy demand across all industries.

According to research from the International Energy Agency (IEA), global energy consumption due to data centers, AI, and the cryptocurrency sector is poised to double from an estimated 460 terawatt-hours (TWh) in 2022 to more than 1,000 TWh by 2026 - an amount roughly equal to Japan's total annual electricity consumption.

Fortunately, technologies pioneered in HPC can play a critical role in improving the efficiency of energy-intensive AI model training and inference (prediction). By leveraging these technologies and taking other measures, such as deploying more energy-efficient servers or improving data center power usage effectiveness (PUE), organizations can dramatically reduce their carbon footprint and help realize a greener, more sustainable future. In addition to providing environmental benefits, more energy-efficient data centers help organizations reduce costs and increase profitability.

Without further ado, let's discuss the challenge of climate change, the promise of HPC, and the challenges of curbing AI's appetite for energy.

HPC and Sustainability

Sustainability has emerged as a key requirement in modern design and manufacturing environments. Faced with longer heatwaves, more wildfires, increasingly intense storms, and growing threats to agriculture and the global food supply, 193 countries and the European Union signed the Paris Agreement, pledging to pursue efforts to limit global temperature rise to 1.5 C above those recorded in pre-industrial times. The goal is to avoid the catastrophic projected impacts of climate change.

Driven by consumer demand and government regulation, most organizations have made public commitments to meet carbon reduction goals as part of corporate ESG programs, and they're incorporating these requirements into their supply chains. Suppliers are increasingly required to disclose greenhouse gas emissions and climate risks in public and private procurements. Common strategies to meet sustainability goals include reducing scope 1 and scope 2 carbon emissions from operations, investing in renewable energy, responsible sourcing and recycling, and purchasing carbon credits to offset emissions.

A Two-Pronged Approach to Reducing Greenhouse Gas Emissions

Manufacturers play an outsized role in enabling a low-carbon future because the lifetime environmental impact of their products tends to dwarf the impact of product design and manufacturing over the product life cycle. Automobiles are a good example. According to the IEA, the total carbon impact of manufacturing a typical internal combustion engine vehicle is approximately six tons of CO2 equivalent (tCO2e). By contrast, operating the car over its lifetime results in approximately 35.9 tCO2e. In other words, roughly 86% of life cycle emissions are due to the fuel cycle and tailpipe emissions.

To meet sustainability goals, manufacturers face two critical challenges:

1. Designing more sustainable, energy-efficient products that exhibit a lower lifetime carbon footprint.
2. Improving the energy efficiency and emissions associated with internal operations, including design, manufacturing, and data center resources.

AI's Insatiable Appetite for Electricity

Advances in AI are transforming a broad variety of industries, from manufacturing to healthcare to retail to financial services. Even with powerful GPUs that deliver almost 6x the model training performance per socket compared to CPUs alone, the power required to train large models is enormous.

What makes AI workloads particularly challenging is that, depending on the model, inference - using an AI model to analyze new data and make predictions - can be even more energy-intensive than model training. Google estimates that 60% of the cost and environmental impact of AI is from inference, due to the sheer number of times predictive models are invoked.

Some examples that highlight the enormous energy requirements and environmental impact of AI model training and inference:

• Training a single generative AI model can take 150,000 GPU hours, equivalent to 11,250 kg CO2e. This is just for images - new AI-powered video generators are even more energy intensive.
• Generating 1,000 images using the Stable Diffusion XL text-to-image model uses the energy equivalent of driving 4.1 km in a gas-powered car. Generating a single image takes as much energy as charging a mobile phone.
• Training a large language model (LLM) such as GPT-4 requires approximately 25,000 GPUs. For GPT-4's 100-day training period (and factoring in overhead), this adds up to ~60,000,000 GPU hours and consumes ~28,800,000 kWh. This translates into 6,912 tCO2e, or the equivalent of powering 1,300 homes for one year.
• According to the IEA, a single ChatGPT query requires 2.9 watt-hours of electricity, compared with 0.3 watt-hours for a Google search - a ~10x increase in energy intensity.
• If all the world's ~1 billion vehicles were suddenly self-driving, the cumulative inference workload would be approximately 21.6 million billion inferences per day - roughly 20,000x that of Facebook.

How HPC and Simulation Can Reduce Life Cycle Carbon Emissions

Though these energy demands are steep, HPC and simulation are essential in designing more sustainable, environmentally friendly products. By employing advanced computer simulation and optimization, organizations can:

• Design lighter, more fuel-efficient products
• Reduce material usage and waste while meeting product performance goals
• Use more sustainable processes and recycled materials
• Employ software-based crash simulations to avoid wasteful physical testing
• Improve product durability and life span to reduce waste
• Reduce transport and packaging costs
• Leverage generative AI to create more energy-efficient designs

In the next article, we'll examine how organizations can make their HPC operations more energy efficient and reduce HPC and simulation's carbon footprint with Altair technology.

To read the full eGuide, visit "Sustainable Computing for HPC and AI."

Public link

Please use the above public link if you want to share this noodl on another website.