I know how machine learning "AI" works, and there, the training is the costly part, using it is close to free.
Could someone knowledgeable explain what's the difference with those more recent large language models used by ghatgpt etc. ?
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
I know how machine learning "AI" works, and there, the training is the costly part, using it is close to free.
Could someone knowledgeable explain what's the difference with those more recent large language models used by ghatgpt etc. ?
Tax pollution and pay the revenue as cash to poor people, it'll figure itself out
The first statement is not even wholly true. While training does take more, executing the model (called "inference") takes much, much more power than non-AI search algorithms, or really any traditional computational algorithm besides bogosort.
Big Tech weren't doing the best they possibly could transitioning to green energy, but they were making substantial progress before LLMs exploded on the scene because the value proposition was there: traditional algorithms were efficient enough that the PR gain from doing the green energy transition offset the cost.
Now Big Tech have for some reason decided that LLMs represent the biggest game of gambling ever. The first to find the breakthrough to AGI will win it all and completely take over all IT markets, so they need to consume as much as they can get away with to maximize the probability that that breakthrough happens by their engineers.
Yeah, I ran some image generators on my RTX2070, and it took a solid minute at full power to do it. Sure, it's not a crazy amount, but it's not like it's running on your iPhone.
At the moment AI is consuming about 3x as much total power as gaming (60 terawatt hrs/yr vs 20), so presumably 3x more environmental impact. So my question is, if one thing is 3x worse does it make the other thing okay? I mean, it seems fair that the power consumption should make us roughly 1/3 as outraged by gaming as we are by AI.
B-b-but...
The outrage is no comparable because games aren't forced down your throat. I've never once asked for an AI summary of something, yet I see them constantly if I don't actively avoid them, so I'm indirectly incurring those costs.
Outrage for other people's environmental effects because they're "forcing it down your throat" but not your own because you're doing it willingly? Yeah, that sounds super morally impeccable!
I never said i was outraged or not. But at least when i game and being morally deplorable, I've actively chosen to do so with intent. That's still way better than them deciding for me to waste the energy when i don't even use the result. If you don't see the difference there isn't much to talk about here.
Youi're right that there isn't much point in this conversation, but completely wrong about the reason. I'm saying if people are upset about the amount of power AI is using they should be at least 1/3 as upset about the power gaming uses. You're saying the bigger issue is AI doing something on your behalf without asking. I don't even know how to address an issue-dodging mentality like that. Oh well.
Don't use services with AI summaries
Hence why I said if I don't actively avoid them. I used those services before AI was a thing. So it was not my decision.
Not sure why I missed that line! The enshitification is tragic
How much energy does AI really use? (zdnet) Seems like queries aren't that expensive, so I guess the enormous energy cost of AI must be mostly from training. I reckon this is why apologists try to minimize it.
That was a shit "article" IMO. "What is a data center" lol, and no figures or explanations. Or did I miss something when I speed read the SEO crap?
You have more brians than any AI shill will ever be able to emulate.
brians
I don't use autocorrect, because misspellings and misstypes are usually more legible than what ever 'other' word autocorrect picks.
... though I'm leaving this one in. A gaggle of Brians is better than any AI shit.