Despite its name, the infrastructure used by the “cloud” accounts for more global greenhouse emissions than commercial flights. In 2018, for instance, the 5bn YouTube hits for the viral song Despacito used the same amount of energy it would take to heat 40,000 US homes annually.
Large language models such as ChatGPT are some of the most energy-guzzling technologies of all. Research suggests, for instance, that about 700,000 litres of water could have been used to cool the machines that trained ChatGPT-3 at Microsoft’s data facilities.
Additionally, as these companies aim to reduce their reliance on fossil fuels, they may opt to base their datacentres in regions with cheaper electricity, such as the southern US, potentially exacerbating water consumption issues in drier parts of the world.
Furthermore, while minerals such as lithium and cobalt are most commonly associated with batteries in the motor sector, they are also crucial for the batteries used in datacentres. The extraction process often involves significant water usage and can lead to pollution, undermining water security. The extraction of these minerals are also often linked to human rights violations and poor labour standards. Trying to achieve one climate goal of limiting our dependence on fossil fuels can compromise another goal, of ensuring everyone has a safe and accessible water supply.
Moreover, when significant energy resources are allocated to tech-related endeavours, it can lead to energy shortages for essential needs such as residential power supply. Recent data from the UK shows that the country’s outdated electricity network is holding back affordable housing projects.
In other words, policy needs to be designed not to pick sectors or technologies as “winners”, but to pick the willing by providing support that is conditional on companies moving in the right direction. Making disclosure of environmental practices and impacts a condition for government support could ensure greater transparency and accountability.
There are layers of wrong and stupid to this article.
Despite its name, the infrastructure used by the “cloud” accounts for more global greenhouse emissions than commercial flights.
“The cloud” accounts for something like 80% of the internet across the entire planet. I’d be curious what 80% of transportation infrastructure would end being in comparison… no takers? We’re only comparing to (some) flights instead of, I dunno, the vast bulk of our fossil fuel powered transport infra?
In 2018, for instance, the 5bn YouTube hits for the viral song Despacito used the same amount of energy it would take to heat 40,000 US homes annually.
Oh no, the most popular song in the world used the same amount of energy as 40k homes in the US. The US probably has something in the range of a hundred million homes. The efficiency of computing equipment increases by a sizable percentage every single year, with the odds being good the same data could be served at 1/20th the cost today. So why aren’t we talking about, say, heat pumps for those homes? You know, since they’re still using the same amount of energy they did in 2018?
…about 700,000 litres of water could have been used to cool the machines that trained ChatGPT-3… Additionally, as these companies aim to reduce their reliance on fossil fuels, they may opt to base their datacentres in regions with cheaper electricity, such as the southern US, potentially exacerbating water consumption issues…
What is this idiocy? You realize that a chip fab uses something to the tune of ten million gallons of water per day, right? Ten million. Per day. I’m not even looking at other industrial processes, which are almost undoubtedly worse (and recycle their water less than fabs) - but if you’re going to whine about the environmental impact of tech, maybe have a look at the manufacturing side of it.
Furthermore, while minerals such as lithium and cobalt are most commonly associated with batteries in the motor sector, they are also crucial for the batteries used in datacentres. The extraction process often involves significant water usage and can lead to pollution, undermining water security. The extraction of these minerals are also often linked to human rights violations and poor labour standards.
Man, we’re really grasping at straws here. More complaining about water usage, pollution, water security, labor standards, human rights violations… wait, were we talking about the costs of data centers or capitalism in general? Because I’m pretty sure these issues are endemic, across every industry, every country, maybe even our entire economic system. Something like a data center, which uses expensive equipment, likely has a lower impact of every single one of these measures than… I dunno… clothes? food? energy production? transport? Honestly guys, I’m struggling to think of an industry that has lower impact, help me out (genuine farm to table restaurants, maybe).
There are things to complain about in computing. Crypto is (at least for the time being) a ponzi scheme built on wasting energy, social media has negative developmental/social effects, etc. But the environmental impact of stuff like data centers… its just not a useful discussion, and it feels like a distraction from the real issues on this front.
In fact I’d go further and say its actively damaging to publish attack pieces like these. The last few years I didn’t drive to the DMV to turn in my paperwork, I did it over the internet. I don’t drive to work because I’m fully remote since the pandemic, cutting my gas/car usage by easily 90%. I don’t drive to blockbuster to pick out videos the way I remember growing up. The sheer amount of physical stuff we used to do to transmit information has been and is gradually all being transitioned to the internet - and this is a good thing. The future doesn’t have to be all bad, folks.
Thank you. The 700000 litres in particular pissed me off… that’s a 9 meter cube. Whoopdie doo
The reason the article compares to commercial flights is your everyday reader knows planes’ emissions are large. It’s a reference point so people can weight the ecological tradeoff.
“I can emit this much by either (1) operating the global airline network, or (2) running cloud/LLMs.” It’s a good way to visualize the cost of cloud systems without just citing tons-of-CO2/yr.
Downplaying that by insisting we look at the transportation industry as a whole doesn’t strike you as… a little silly? We know transport is expensive; It is moving tons of mass over hundreds of miles. The fact computer systems even get close is an indication of the sheer scale of energy being poured into them.
and recycle their water less than fabs
Which is actually a very good idea economics-wise but fabs didn’t care much for the longest time because while crucial it’s still a minor part of their operating infrastructure. They had bigger fish to fry.
The thing is if you clean a wafer with ultrapure water, the resulting waste water might have some nasty stuff in it… but tap water has more stuff in it, just not as nasty. They generally need to process the waste water to be environmentally safe, anyway, doesn’t take much to feed it back into the cycle and turn it into ultrapure, again.
Side note in case you’re wondering what it’s like to drink that kind of water: It’s basically a novel way to burn your tongue. The osmotic pressure due to lack of minerals will burst cell walls but you’re not a microorganism so you’ll most likely be fine and the load on your overall mineral stores is only marginally higher than when drinking ordinary water, we get the vast majority of our minerals from food.
But the environmental impact of stuff like data centers… its just not a useful discussion,
I’d say it is but more along the lines of feeding waste heat into district heating. Someone can shower with those CPU cycles.
with the odds being good the same data could be served at 1/20th the cost today
Gotta nitpick you there. According the Moore’s law (really more of a rule of thumb), the price of the silicon used to serve those videos should be 1/16 of what it is today. I’m not aware of any corresponding law that describes trends in energy consumption. It’s getting better for sure, but I’d be shocked if there was a 20x improvement in 6 years.
Yes it does, and wait until you hear about literally every other industry.
That’s wrong, I buy drugs online with cryptocurrencies all the time to this day and have done it long before the normies showed up and turned it into a mostly financial scam.
Evading the man and LEOs when the law ain’t right is my god-given right and I’m thankful to be born in the age of onions and crypto.
That other poster is using a disingenuous debate tactic called “whataboutism”. Basically shifting the focus from what’s being criticised (AI resource consumption) to something else (other industries).
Your comparison with evangelists is spot on. In my teen years I used to debate with creationists quite a bit; they were always
- oversimplifying complex matters
- showing blatant lack of reading comprehension, and distorting/lying what others say
- vomiting certainty on things that they assumed, and re-eating their own vomit
- showing complete inability to take context into account when interpreting what others say
- chain-gunning fallacies
- “I’m not religious, but…”
always to back up something as idiotic as “the world is 6kyo! Evolution is a lie!”.
Does it ring any bell for people who discuss with AI evangelists? For me, all of them.
(Sorry bolexforsoup for the tone - it is not geared towards you.)
Go on benefiting from the people who actually do stuff while simultaneously whining about it. You’ve been using AI for 20 years, you’re just too thick to know about it. There are millions of people in 2nd and 3rd world countries who have had their lives massively improved thanks to bitcoin, you’re just too spoiled and naive and to give a shit about them. Climb down off your soap box and go read something beyond the headline.
“aI AnD cRyPtO aRe ThE sAmE bRo”
You know that your take that they both must suck in the exact same ways just because tech bros get hyped about them, is literally just as shallow, surface level, and uninformed as most tech bros?
Like yeah man, tech hype cycles suck. But you know what else was once a tech hype cycle? Computers, the internet, smartphones. Sometimes they are legitimate, sometimes not.
AI is solving an entirely new class of problem that computers have been literally unable to solve for their entire existence. Crypto was solving the problem of making a database without a single admin. One of those is a lot more important and foundational than the other.
On top of that, crypto algorithms are fundamentally based on “proof of work”, i.e. literally wasting more energy than other miners in the network is a fundamental part of how their algorithm functions. Meaning that with crypto there is basically no value prop to society and it inherently tries to waste energy, neither is the case for AI.
Plus guess how much energy everyone streaming 4K video would take if we were all doing it on CPUs and unoptimized GPUs?
Orders of magnitude more power than every AI model put together.
But guess what? Instead we invented 4k decoding chips that are optimized to redner 4k signals at the hardware level so that they don’t use much power, and now every $30 fire stick can decode a 4k signal on a 5V usb power supply.
That’s also where we’re at with the first Neural Processing Units only just hitting the market now.
Cryptos have drastically reduced their energy consumption through technological improvements.
That’s why nobody complains about crypto energy consumption anymore. It’s just bitcoin.
But these LLMs just need more and more with no end in sight.
Funny how 99.99% of cryptos shrivel up and die while bitcoin continues to serve people all over the world and is constantly becoming more and more popular. Maybe if you lived with, or even gave a shit about, people in below average wealth countries you would understand why Bitcoin is so useful to them.
“The world is complicated and scary! I don’t understand it so it must be bad! M-muh planet farting cows evil industry fuck the disabled/sick/queer!” - What luddites actually believe.
Anprims/eco-fashes begone. If the planet was destroyed for the betterment of conditions for the proletariat today and future alike there’d be literally no issue, it’s just some rock lol, AI is far more important. Also brutalism and soviet blocs are the best architectural styles, everything else is bourgeois cringe.
What is this even? Batteries for UPS in a datacenter wouldn’t be a patch on even a few days of production of EVs, water isn’t being shipped from “drier parts of the world” to cool datacenters, and even if it were, it’s not gone forever once it’s used to cool server rooms.
Absolutely, AI and crypto are a blight on the energy usage of the world and that needs to be addressed, but things like above just detract from the real problem.
The water is because datacenters have been switching to evaporative cooling to save energy. It does save energy, but at the cost of water. It doesn’t go away forever, but a lot of it does end up raining down on the ocean, and we can’t use it again without desalination and using even more energy.
That may all be true, but the amount of water used by these data centers is miniscule, and it seems odd to focus on it. The article cites Microsoft using 700,000 liters for ChatGPT. In comparison, a single fracking well in the same state might use 350,000,000 liters, and this water is much more contaminated. There are so many other, more substantive, issues with LLMs, why even bring water use up?
Edit: If evaporative cooling uses less energy it might even be reducing total industrial water use, considering just how much water is used in the energy industry.
a lot of it does end up raining down on the ocean, and we can’t use it again without desalination
Where do you think rain comes from? Why do hurricanes form over the ocean?
Dude, please. If things just worked out like that, we wouldn’t have water issues piling up with the rest of our climate catastrophe.
Pass a carbon tax. Oh wait that would be too easy.
It seems the people who are the most staunch defenders of capitalism and free markets are the most resistant to the capitalist and free market solution.
Clean air (or rather, air with normal levels of carbon) belongs to the public, and anyone who wants to take it away should pay the public.
Sigh. You can hold any opinion you want about the ideal society. This is a good idea for the society we have now. If we all die it’s not going to matter if Adam Smith or Karl Marx was correct.
Why don’t you just hand over all your income to the government just to be sure you won’t engage in any unnecessary activity.
What are you on about? A carbon tax is a way to lower the tragedy of the commons in terms of air pollution. It is the free market compromise. Allowing individuals and companies time and giving them incentive to stop doing something that hurts us as a whole. The socialist answer would be to ban it outright. You are getting the best solution the capitalist market allows. Additionally it aligns pretty well with traditional capitalist economists have argued before: a resource owned as a whole will be mismanaged.
I honestly don’t get why it isn’t a more popular idea. I would much rather live in a world where people are being gently pushed into making the right decision with adequate time to adapt vs a world that is on fire.
And on the off chance that 99% of climate science is wrong we still benefit from having a less acidic ocean, less smog, less local air pollution, and spending less money on maintenance of so many machines.
So… Absolutely need to be aware of the impact of what we do in the tech sphere, but there’s a few things in the article that give me pause:
Research suggests, for instance, that about 700,000 litres of water could have been used to cool the machines that trained ChatGPT-3 at Microsoft’s data facilities.
- “Could”. More likely it was closed loop.
- Water isn’t single use, so even if true how does this big number matter.
What matter is the electrical energy converted to heat. How much was it and where did that heat go?
Moreover, when significant energy resources are allocated to tech-related endeavours, it can lead to energy shortages for essential needs such as residential power supply. Recent data from the UK shows that the country’s outdated electricity network is holding back affordable housing projects.
Can you say non sequitur ?
The outdated network holding back housing is that it doesn’t go to the right places with the capacity needed for the houses. Not that OpenAIUK is consuming so much that there’s no power left. To use a simily, there’s plenty of water but the pipes aren’t in place.
This article is well intentioned FUD, but FUD none the less.
700.000 litres also sounds like much more than 700 m³. The average German citizen consumed 129 litres per day or roughly 47 m³ annually. The water consumption of 15 people is less than most blocks.
Energy consumption might be a real problem, but I don’t see how water consumption is that big of a problem or priority here.
Liters are a great unit for making small things seem large. I’ve seen articles breathlessly talking about how “almost 2000 liters of oil was spilled!” When 2000 liters could fit in the back of a pickup truck.
Water “consumption” is also a pretty easy to abuse term since water isn’t really consumed, it can be recycled endlessly. Whether some particular water use is problematic depends very much on the local demands on the water system, and that can be accounted for quite simply by market means - charge data centers money for their water usage and they’ll naturally move to where there’s plenty of cheap water.
Liters are a great unit for making small things seem large. I’ve seen articles breathlessly talking about how “almost 2000 liters of oil was spilled!” When 2000 liters could fit in the back of a pickup truck.
That just means you have no intuitive sense of how large a litre is. If they’d written it as “2000 quarts” (which is close enough to being the same volume at that level of rounding) would it have painted a clearer picture in your head?
Oil is different because 1 ppm can ruin a whole litre or something in that direction.
The average German citizen consumed 129 litres per day
That seems like a lot. Where are you getting that number?
Edit: consumes = uses not drinks
The EPA states that each American uses an average of 82 gallons or 310.4 litres a day (study from 2015). Source: https://www.epa.gov/watersense/statistics-and-facts
A quick search says 3.7L is the recommended intake for men, and 2.7L for women. Forget AI, Germans appear to be the real resource guzzlers!
“Could”. More likely it was closed loop. As I understand it this is an estimate, thus the word “could”. This has nothing to do with using closed or open look water cooling. Water isn’t single use, so even if true how does this big number matter.
The point they are trying to make is that fresh water is not a limitless resource and increasing usage has various impacts, for example on market prices.
The outdated network holding back housing is that it doesn’t go to the right places with the capacity needed for the houses. Not that OpenAIUK is consuming so much that there’s no power left. To use a simily, there’s plenty of water but the pipes aren’t in place.
The point being made is that resources are allocated to increase network capacity for hyped tech and not for current, more pressing needs.
Is there a reason it needs to be fresh water? Is sea water less effective?
A lot of industry does use grey water or untreated water for cooling as it’s substantially cheaper to filter it and add chemicals to it yourself. What’s even cheaper is to have a cooling tower and reuse your water, in the volumes it’s used at industrial scales it’s really expensive to just dump down the drain (which you also get charged for), when I worked as a maintenance engineer I recall saving something like 1m cad minimum a year by changing the fill level in our cooling tower as it would drop to a level where it’d trigger city water backups to top up the levels to avoid running dry, and that was a single processing line.
“Could”. More likely it was closed loop.
Nope. Here’s how data centres use water.
It boils down to two things - cooling and humidification. Humidification is clearly not a closed loop, so I’ll focus on the cooling:
- cold water runs through tubes, chilling the air inside the data centre
- the water is now hot
- hot water is exposed to outside air, some evaporates, the leftover is colder and reused.
Since some evaporates you’ll need to put more water into the system. And there’s an additional problem: salts don’t evaporate, they concentrate over time, precipitate, and clog your pipes. Since you don’t want this you’ll eventually need to flush it all out. And it also means that you can’t simply use seawater for that, it needs to be freshwater.
Water isn’t single use, so even if true how does this big number matter.
Freshwater renews at a limited rate.
What matter is the electrical energy converted to heat. How much was it and where did that heat go?
Mostly to the air, as promoting the evaporation of the water.
Can you say non sequitur ?
More like non sequere than non sequitur. Read the whole paragraph:
Moreover, when significant energy resources are allocated to tech-related endeavours, it can lead to energy shortages for essential needs such as residential power supply. Recent data from the UK shows that the country’s outdated electricity network is holding back affordable housing projects. This will only get worse as households move away from using fossil fuels and rely more on electricity, putting even more pressure on the National Grid. In Bicester, for instance, plans to build 7,000 new homes were paused because the electricity network didn’t have enough capacity.
The author is highlighting that electrical security is already bad for you Brits, for structural reasons; it’ll probably get worse due to increased household consumption; and with big tech consuming it, it’ll get even worse.
Data center cooling towers can be closed- or open-loop, and even operate in a hybrid mode depending on demand and air temps/humidity. Problem is, the places where open-loop evaporative cooling works best are arid, low-humidity regions where water is a scarce resource to start.
On the other hand, several of the FAANGS are building datacenters right now in my area, where we’re in the watershed of the largest river in the country, it’s regularly humid and rainy, any water used in a given process is either treated and released back into the river, or fairly quickly condenses back out of the atmosphere in the form of rain somewhere a few hundred miles further east (where it will eventually collect back into the same river). The only way that water is “wasted” in this environment has to do with the resources used to treat and distribute it. However, because it’s often hot and humid around here, open loop cooling isn’t as effective, and it’s more common to see closed-loop systems.
Bottom line, though, I think the siting of water-intensive industries in water-poor parts of the country is a governmental failure, first and foremost. States like Arizona in particular have a long history of planning as though they aren’t in a dry desert that has to share its only renewable water resource with two other states, and offering utility incentives to potential employers that treat that resource as if it’s infinite. A government that was focused on the long-term viability of the state as a place to live rather than on short-term wins that politicians can campaign on wouldn’t be making those concessions.
They can be closed-loop as in your region but they usually aren’t - besides the problem that you mentioned, a closed loop increases electricity consumption (as you’ll need a heat pump instead), and electricity consumption is also a concern. Not for the environmental impact (corporations DGAF), but price.
