{"id":2133,"date":"2024-08-31T18:16:32","date_gmt":"2024-09-01T01:16:32","guid":{"rendered":"https:\/\/www.digivideoplus.com\/dv_blog\/?p=2133"},"modified":"2024-10-18T21:36:04","modified_gmt":"2024-10-19T04:36:04","slug":"the-darkside-of-ai-outages-and-shortages","status":"publish","type":"post","link":"https:\/\/www.digivideoplus.com\/dv_blog\/2024\/08\/31\/the-darkside-of-ai-outages-and-shortages\/","title":{"rendered":"The darkside of AI \u2013 outages and shortages"},"content":{"rendered":"\n
\"What<\/a><\/figure>\n\n\n\n

Another gold rush<\/em> is underway. Recast as the AI tech boom. Yet, AI is power hungry, a voracious beast consuming vast amounts of electricity. And water [1]. And those gas-fired power plants [2] \u2026<\/p>\n\n\n\n

Generative AI data centers are expensive to build, expensive to operate, and tax the electric grid and our limited water resources (like the Colorado River).<\/p>\n\n\n\n

Companies that invest in AI see profit. Electric utilities see profit from AI-induced demand for power. Local governments see profit from property taxes paid by data centers. Sort of a greed cycle .. what could go \u2026<\/p>\n\n\n\n

This LA Times<\/em> article reminds us that there’s no “free lunch” \u2013 the seductive offer by tech and social media to entice AI-sipping customers.<\/p>\n\n\n\n

\"\"<\/a><\/figure>\n\n\n\n
\n

The “free lunch” in the saying refers to the formerly common practice in American bars of offering a “free lunch” in order to entice drinking customers. – Wiki<\/p>\n<\/blockquote>\n\n\n\n

\u2022 LA Times > “Power demands of AI data centers raise concerns over cost, blackouts” by Melody Petersen (8-31-2024) \u2013 Experts warn construction frenzy could delay state’s transition away from fossil fuels.<\/p>\n\n\n\n

\n

In Santa Clara \u2014 the heart of Silicon Valley \u2014 electric rates are rising as the municipal utility spends heavily on transmission lines and other infrastructure to accommodate the voracious power demand from more than 50 data centers, which now consume 60% of the city’s electricity.<\/p>\n\n\n\n

While the benefits and risks of AI continue to be debated, one thing is clear: The technology is rapacious for power. Experts warn that the frenzy of data center construction could delay California’s transition away from fossil fuels and raise electric bills for everyone else. The data centers’ insatiable appetite for electricity, they say, also increases the risk of blackouts.<\/p>\n\n\n\n

According to the International Energy Agency, a ChatGPT-powered search consumes 10 times the power as a search on Google without AI.<\/p>\n\n\n\n

And because those new chips generate so much heat, more power and water is required to keep them cool.<\/p>\n\n\n\n

By 2030, data centers could account for as much as 11% of U.S. power demand \u2014 up from 3% now, according to analysts at Goldman Sachs.<\/p>\n<\/blockquote>\n\n\n\n

Notes<\/h4>\n\n\n\n

[1] This article uses infographics to visualize data center cooling footprints (water and electricity loads, which vary by state) for processing ChatGPT prompts.<\/p>\n\n\n\n

Those transactional footprints beg the months of cooling required to first train chatbots. Estimates range from 700,000 to 22,000,000 liters of water to train some AI models.<\/p>\n\n\n\n

Water replenishment rates by tech companies are unclear, while they pledge to make AI less thirsty.<\/p>\n\n\n\n

References on methodology are included.<\/p>\n\n\n\n

\u2022 Washington Post > POWER GRAB > “A bottle of water per email: the hidden environmental costs of using AI chatbots<\/a>” by Pranshu Verma and Shelly Tan (September 18, 2024) \u2013 AI bots generate a lot of heat, and keeping their computer servers running exacts a toll.<\/p>\n\n\n\n

\n

While the exact burden is nearly impossible to quantify, The Washington Post worked with researchers at the University of California, Riverside to understand how much water and power OpenAI’s ChatGPT, using the GPT-4 language model released in March 2023, consumes to write the average 100-word email.<\/p>\n\n\n\n

Even in ideal conditions, data centers are often among the heaviest users of water in the towns where they are located, environmental advocates said. But data centers with electrical cooling systems also are raising concerns by driving up residents’ power bills and taxing the electric grid.<\/p>\n<\/blockquote>\n\n\n\n

An earlier article uses infographics as well to better understand what goes on in data centers.<\/p>\n\n\n\n

\u2022 Washington Post > POWER GRAB > “Our digital lives need massive data centers. What goes on inside them?<\/a>” by Antonio Olivo and William Neff (September 17, 2024) \u2013 We toured a facility in Northern Virginia to see how it works and to understand why water use and energy consumption are such a concern.<\/p>\n\n\n\n

\n

More than half a million people in Northern Virginia<\/strong> live in a neighborhood that’s less than a mile from a data center. That’s more than 1 in 5 residents.<\/p>\n\n\n\n

There are four main types of data centers<\/strong>:<\/p>\n\n\n\n

An “enterprise” data center<\/strong> serves the needs of the company that owns it. Think of a corporation that stores in-house information on its own computers.<\/p>\n\n\n\n

Larger “hyperscale” data centers<\/strong>, owned by companies such as Amazon or Meta, have computer servers that cater solely to the company’s customers.<\/p>\n\n\n\n

“Edge” data centers<\/strong> are smaller buildings in or near major population centers, where digital connectivity becomes almost instantaneous for, say, a passing driverless car.<\/p>\n\n\n\n

Equinix<\/strong> is among the world’s largest owners of “colocation” data centers<\/strong>. Those facilities lease space to other businesses that hook up their servers to cables that belong to the data center company.<\/p>\n<\/blockquote>\n\n\n\n

[2] As in plans for global data centers \u2026<\/p>\n\n\n\n

\u2022 Data Center Knowledge > “Oracle CloudWorld 2024: Embracing Multi-Cloud, Nuclear Energy, and Other Event Highlights<\/a>” (September 12, 2024) \u2013 Alternative energy sources are crucial to the success of data centers globally.<\/p>\n\n\n\n

\n

Nuclear Power in the AI Age<\/p>\n\n\n\n

Ellison made one of Oracle’s biggest headlines of the week with his Monday earnings call announcement the company would invest in three small nuclear reactors<\/strong> to power a data center with over 1 GW of AI capacity. Although his keynote address at CloudWorld didn’t provide any additional details, Ellison said that while Oracle now runs over 162 data centers globally<\/strong>, they could soon be operating over 1,000 facilities.<\/p>\n\n\n\n

“Alternative energy sources are crucial<\/strong> to their success,” Kevin Sullivan, a principal at Pricewaterhouse Cooper, told Data Center Knowledge. “Nuclear, on a personal level, makes me a little nervous. Other alternative energy sources might be better options. But all options need to be available.”<\/p>\n<\/blockquote>\n\n\n\n

As reported in this article (and elsewhere), here is yet another portent of the thirst for electric power by the boom in artificial intelligence. A novel idea? More similar deals to come? More move fast and let things break (again), eh.<\/p>\n\n\n\n

\u2022 Washington Post > “Microsoft deal would reopen Three Mile Island nuclear plant to power AI<\/a>” by Evan Halper (September 20, 2024) \u2013 Supposedly shuttered for good (decommissioned) in 2019, the Pennsylvania plant would come back online by 2028 if approved by regulators.<\/p>\n\n\n\n

\n

Pennsylvania\u2019s dormant Three Mile Island nuclear plant [site of the 1979 partial reactor meltdown] would be brought back to life to feed the voracious energy needs of Microsoft under an unprecedented deal announced Friday in which the tech giant would buy 100 percent of its power for 20 years. \u2026 the energy equivalent it takes to power 800,000 homes, or 835 megawatts.<\/p>\n\n\n\n

The four-year restart plan would cost Constellation [plant owner Constellation Energy] about $1.6 billion, he said, and is dependent on federal [public] subsidies in the form of [undisclosed] tax breaks earmarked for nuclear power in the 2022 Inflation Reduction Act.<\/p>\n\n\n\n

Constellation will also need to clear steep regulatory hurdles, including intensive safety inspections from the federal Nuclear Regulatory Commission, which has never before authorized the reopening of a plant. The deal also raises thorny questions about the federal tax breaks, as the energy from the plant would all be produced for a single private company rather than a utility serving entire communities.<\/p>\n\n\n\n

\u201cIt doesn\u2019t address the core issues that are making the current practice of AI unsustainable by definition,\u201d she [Sasha Luccioni, the top climate executive at sustainable AI start-up Hugging Face] said of the deal. \u201cInstead of monopolizing decommissioned nuclear power plants, we should be focusing on integrating sustainability into AI.\u201d<\/p>\n<\/blockquote>\n\n\n\n

Related posts<\/h4>\n\n\n\n

\u2022 AI chatbot reality check \u2013 the bottom line?<\/a><\/p>\n\n\n\n

<\/p>\n","protected":false},"excerpt":{"rendered":"

Another gold rush is underway. Recast as the AI tech boom. Yet, AI is power hungry, a voracious beast consuming vast amounts of electricity. And water [1]. And those gas-fired power plants [2] \u2026 Generative AI data centers are expensive to build, expensive to operate, and tax the electric grid and our limited water resources […]<\/p>\n","protected":false},"author":2,"featured_media":1868,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3,1,6],"tags":[191,250,247,251,187,249,252,248],"class_list":["post-2133","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-computer","category-general","category-research","tag-ai","tag-blackouts","tag-grid","tag-nuclear-power","tag-power","tag-profit","tag-small-nuclear-reactor","tag-water"],"_links":{"self":[{"href":"https:\/\/www.digivideoplus.com\/dv_blog\/wp-json\/wp\/v2\/posts\/2133","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.digivideoplus.com\/dv_blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.digivideoplus.com\/dv_blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.digivideoplus.com\/dv_blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.digivideoplus.com\/dv_blog\/wp-json\/wp\/v2\/comments?post=2133"}],"version-history":[{"count":3,"href":"https:\/\/www.digivideoplus.com\/dv_blog\/wp-json\/wp\/v2\/posts\/2133\/revisions"}],"predecessor-version":[{"id":2156,"href":"https:\/\/www.digivideoplus.com\/dv_blog\/wp-json\/wp\/v2\/posts\/2133\/revisions\/2156"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.digivideoplus.com\/dv_blog\/wp-json\/wp\/v2\/media\/1868"}],"wp:attachment":[{"href":"https:\/\/www.digivideoplus.com\/dv_blog\/wp-json\/wp\/v2\/media?parent=2133"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.digivideoplus.com\/dv_blog\/wp-json\/wp\/v2\/categories?post=2133"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.digivideoplus.com\/dv_blog\/wp-json\/wp\/v2\/tags?post=2133"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}