688
"AI" rule (lemmynsfw.com)
submitted 3 months ago by [email protected] to c/[email protected]
you are viewing a single comment's thread
view the rest of the comments
[-] [email protected] 55 points 3 months ago

What country? Sir Lanka? This isn't a useful comparison as is, I'll see if I can dig up actual numbers.

[-] [email protected] 21 points 3 months ago

Following for the results of your work here so I can use it in the future.

[-] [email protected] 70 points 3 months ago

From this 2023 paper, looks like if all Nvidia AI servers are running 24/7, you'd get an energy consumption of about 5.7–8.9 TWh per year. Nvidia servers make up 95% of the AI market (according to the paper) so that'd be pretty close to what AI servers would consume.

The paper also estimates about 20% of crypto mining GPUs no longer mining etherium converted to AI, which contributed another 16.1 TWh per year.

This doesn't include some AI, but it should be the majority.

Between those two sources, that gives 23.4 TWh per year. That gives 0.08 exta joules per year per this converter. That's 22% of Sri Lanka's energy consumption (which is the lowest country).

So AI in a year uses at much energy as Sri Lanka uses in 3 months. At least in 2023. I'll see if I can find a more recent study.

[-] [email protected] 23 points 3 months ago

So that assumes AI requests use 100 percent of the hardware 100 percent of the time.

[-] [email protected] 14 points 3 months ago* (last edited 3 months ago)

Yes, but those servers are pretty ai specific, so that's a decent assumption. Looks like Nvidia is drastically ramping up production of these servers, so current electricity use might be about 10x, I'm working on it.

[-] [email protected] 1 points 2 months ago

100% utilization 100% of the time? That seems like an unlikely figure, right?

[-] [email protected] 2 points 2 months ago

100% utilization yes, but server uptimes are in the 99 percent range.

[-] [email protected] 1 points 2 months ago

Idle consumption vs full utilization consumption are two very different things, though - this will have a large impact on the final number.

[-] [email protected] 15 points 3 months ago

This is the kind of comment I love on Lemmy.

[-] [email protected] 4 points 3 months ago

Omg it's the guy from the meme

[-] [email protected] 11 points 3 months ago

If you want to be snarky, at least be accurate.

this post was submitted on 23 Apr 2025
688 points (100.0% liked)

196

5379 readers
537 users here now

Be sure to follow the rule before you head out.


Rule: You must post before you leave.



Other rules

Behavior rules:

Posting rules:

NSFW: NSFW content is permitted but it must be tagged and have content warnings. Anything that doesn't adhere to this will be removed. Content warnings should be added like: [penis], [explicit description of sex]. Non-sexualized breasts of any gender are not considered inappropriate and therefore do not need to be blurred/tagged.

Also, when sharing art (comics etc.) please credit the creators.

If you have any questions, feel free to contact us on our matrix channel or email.

Other 196's:

founded 2 years ago
MODERATORS