this post was submitted on 25 May 2024
831 points (100.0% liked)

Technology

67422 readers
3491 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

Google rolled out AI overviews across the United States this month, exposing its flagship product to the hallucinations of large language models.

top 50 comments
sorted by: hot top controversial new old
[–] [email protected] 267 points 10 months ago* (last edited 10 months ago) (6 children)

The head of Google *Search right now is the same guy that was head of yahoo search when it was dying. To put all of this in perspective.

[–] [email protected] 81 points 10 months ago (1 children)

The head of Google Search

FTFY

[–] [email protected] 105 points 10 months ago (3 children)

Thanks.
Being a CEO must be amazing. You can fail and even bring an entire company down, and keep on getting the same job somewhere else.

[–] [email protected] 28 points 10 months ago

He has experience and obviously that means he learned a lesson after failing at a job that requires being a belligerent asshole to get.

[–] [email protected] 13 points 10 months ago (6 children)

I get your point but from a business perspective Google is doing pretty well (see last quarterly earning and they announced dividends for the first time). It's good to be a shareholder and from that perspective the CEO is doing a good job.

Time and time again markets have shown, within reason, poor user experience and anti-consumer policies do not negatively impact stock price.

[–] [email protected] 24 points 10 months ago* (last edited 10 months ago) (1 children)

Well not when it's a company that people can't get away from. Big tech is so big and there are so few alternatives that they can treat people how they like.

We are living in the mega corp world now where they have more money than countries.

Money is power to make the rules what you want.

load more comments (1 replies)
[–] [email protected] 22 points 10 months ago (6 children)

It's relatively easy to squeeze a profit boost by sacrificing long term vision.... Last quarter will mean nothing if Google is knocked from its pedestal in a year or two (which is what the current trend looks to be pointing to)

load more comments (6 replies)
load more comments (4 replies)
load more comments (1 replies)
load more comments (4 replies)
[–] [email protected] 176 points 10 months ago (10 children)

Can we swap out the word "hallucinations" for the word "bullshit"?

I think all AI/LLM stuf should be prefaced as "someone down the pub said..."

So, "someone down the pub said you can eat rocks" or, "someone down the pub said you should put glue on your pizza".

Hallucinations are cool, shit like this is worthless.

[–] [email protected] 79 points 10 months ago (32 children)

No, hallucination is a really good term. It can be super confident and seemingly correct but still completely made up.

[–] [email protected] 35 points 10 months ago (1 children)

It is, but it isnt applicable in at least the glue-pizza situation as the probable source comment has been found on reddit.

A better use of the term might be how when you try to get Bing's image creator to make "Battletech" art, you just mostly get really obvious Warhammer 40k Space Marines and occasionally Iron Maiden album art.

load more comments (1 replies)
load more comments (31 replies)
[–] [email protected] 30 points 10 months ago (5 children)

Google search isnt a hallucination now though.

It instead proves that LLMs just reproduce from the model they are supplied with. For example, the "glue on pizza" comment is from a reddit user called FuckSmith roughly 11 years ago.

load more comments (4 replies)
load more comments (8 replies)
[–] [email protected] 115 points 10 months ago (2 children)

Testing in Prod. Stay classy, Google.

“The vast majority of AI Overviews provide high quality information, with links to dig deeper on the web,” said a Google spokesperson in an emailed statement to Gizmodo, noting many of the examples the company has seen have been from uncommon queries.

This is entirely fair. There is no way that anyone at Google could have anticipated that humans would search for strange things on the internet.

[–] [email protected] 30 points 10 months ago (1 children)

The vast majority of AI Overviews provide high quality information

According to some fuckwitted Google rep, and I wouldn't trust them any further than I could throw them.

load more comments (1 replies)
[–] [email protected] 12 points 10 months ago (3 children)

Although any sociologist or veteran of the internet will tell you humans will engage in any exploit that yields a funny result. The Diet Coke + Mentos rule.

And that means we'll actively search for hilarious Google AI responses.

Google is so f double-plus filthy rich, it is obligated to run its projects by experts or be relentlessly mocked. So it should have known this was the outcome.

Unless this is 5D chess and Google is willfilly using itself as a cautionary tale to discourage future webservice sites from arbitrarily inserting AI into its features.

load more comments (3 replies)
[–] [email protected] 78 points 10 months ago (1 children)

"Hey, we just promised you answers. We never promised you correct answers." -- Google Marketing, probably.

load more comments (1 replies)
[–] [email protected] 66 points 10 months ago (2 children)

On the other hand, all these AI errors by Google have made for some great memes recently.

[–] [email protected] 36 points 10 months ago

LLM aka a Large Language Memes

load more comments (1 replies)
[–] [email protected] 59 points 10 months ago

I mean.. yeah layoff a whole bunch of people and start treating your employees like replaceable commodities.. then go ahead and arrogantly deploy technology you don't understand and :surprisepikachu: everything breaks.

But management get to do things without personal consequence, as they'll just lay off more workers to cover their absolute incompetence and things will continue to get worse.

Perhaps we should be replacing C-suite dipshits with AI's instead.

[–] [email protected] 55 points 10 months ago (8 children)

Why does search need to be AI? I've had no problems finding any information I wanted under the former process.

[–] [email protected] 43 points 10 months ago (9 children)

I think the idea is that you won't even leave the Google page at all, they want to keep you on their site and serve you their ads instead of sending you to someone else's site and giving someone else that sweet sweet ad revenue.

load more comments (9 replies)
[–] [email protected] 23 points 10 months ago

I think it's been a long time since digital companies tried to solve actual problems.

[–] [email protected] 17 points 10 months ago (1 children)

You obviously haven’t used the ~~web3 nocode blockchain NFT~~ AI enough to have an informed opinion.

load more comments (1 replies)
[–] [email protected] 12 points 10 months ago

It’s become more efficient to get basic info on virtually any topic by just asking an LLM like ChatGPT and that could be a serious threat to Google Search. People might form the habit of asking AIs for everything and then go to Google Search only when they want to dig deeper / find relevant articles etc. So I assume they added their own AI right into Search in an effort to continue being the first (and perhaps only) place one goes to for information.

load more comments (4 replies)
[–] [email protected] 52 points 10 months ago* (last edited 10 months ago) (7 children)

Today I caught myself unconsciously went to Duckduckgo to make a search (even tho the browser start page is already google).

Thinking back, I've been using duckduckgo more than google, and often because I can't find what I'm looking for on Google but ads and autogenerated fake webpages.

History will prove it once again, there's no such thing as "too big to fail".

load more comments (7 replies)
[–] [email protected] 36 points 10 months ago* (last edited 10 months ago) (4 children)

TBH I hate the term "hallucination" in this context. It's just more BS anthropomorphizing. More marketing for "AI" (also BS). Can't we just call it like garbage or GIGO or something more accurate? This is nothing new. I know that scientific accuracy is anathema to AI marketing but just saying...

[–] [email protected] 17 points 10 months ago (2 children)

scientific accuracy is anathema to AI marketing

Even though I agree in this context “hallucination” is actually the scientific term. It might be poorly chosen but in LLM circles if you use the term hallucination, the vast majority of people, will understand precisely what you mean, namely not an error in programming, or a bad dataset, but rather that the language model worked well, generating sentences that are syntactically correct, that are roughly thematically coherent, and yet are factually incorrect.

So I obviously don't want to support marketing BS, in AI or elsewhere, but here sadly it matches the scientific naming.

PS: FWIW I believed I made a similar critic few months, or maybe even years, ago. IMHO what's more important is arguably questioning the value of LLMs themselves, but then it might not be as evident for many people who are benefiting from the current buzz.

load more comments (2 replies)
load more comments (3 replies)
[–] [email protected] 31 points 10 months ago (1 children)

This is what I love about Mike Judge's work. It turns out to be always the best metaphor/reference/prophecy of the boring dystopia. Since 1999.

[–] [email protected] 36 points 10 months ago (1 children)

Idiocracy is the most unrealistic sci-fi/apocolyptic film ever made. President Comacho finds the most qualified person to help with a crisis, asks them for advice and then doesnt take credit for it. Noone put in a position of power would ever do that.

load more comments (1 replies)
[–] [email protected] 26 points 10 months ago

Like we’ve seen before with AI chatbots, this technology seems to confuse satire with journalism

Unfortunately so does my aunt. And she's allowed to vote.

[–] [email protected] 24 points 10 months ago (6 children)

Does anyone have a realistic idea of how this happened? I get Google has been fallen off for awhile but they're still a multi billion dollar company.

[–] [email protected] 25 points 10 months ago

Worked for a company that had google as a client:

Google sucks, everyone who works there is an idiot who sniffs their ass all day, nothing works, nothing gets fixed, it's all just held together with duct tape.

[–] [email protected] 22 points 10 months ago (1 children)

I can't imagine a ton of the people working there give a shit anymore when it seems like thousands of people are being layed off weekly while the company takes in billions in profit

load more comments (1 replies)
[–] [email protected] 20 points 10 months ago

Easy: worse results with more ads means more searches and thus more ad impressions, therefore profit.

That'll only work for so long, but that seems to be what they're doing.

[–] [email protected] 16 points 10 months ago* (last edited 10 months ago) (4 children)

I'm probably late, but in this case this is the combinations of 2 things.

  1. The usual capitalistic incentives ruined yet another company. There was a recent article about how Google pushed out the people who builded and maintaned search on favor of MBA growth focused assholes. Like they put the guy that was Yahoo's CEO while Yahoo search was crumbling, in charge of Google search to get him to increase the amount of searches they serve, and ads obviously. People keep suggesting to use DDG, or Kagi, or some other comercial product. And for now, we must because Google is basically useless right now. But just give time to the other companies to fall in the same trap hahaha.
  2. LLMs are not smart, not even close. They are just a parlor trick that has non technical people fooled. There is a lot of evidence to me, but to me the most obvious one is that they don't have anything resembling human short term memory. Like the way they make them look like they are having a conversation is by providing the entire conversation up to that point, including their own previous responses lol, as input/context so the bot autocompletes the conversation. It literally can't remember a single word of what you said on it's own. But sureee, they are just like humans lol.

So what we have here is obvious, we have a company trying to grow like cancer by any means necessary. And now they have a technology that allows them to create enough smoke and mirrors to fool non technical people. Sadly, as part of this they are also destroying the last places of the internet not fully controlled by corporations. Let's hope lemmy survives, but it's just a matter of time before they flood this place too.

load more comments (4 replies)
[–] [email protected] 13 points 10 months ago

Always remember that having more money doesn't mean someone (or some entity) is more capable or intelligent. It just means they have way more latitude to fuck up, higher potential to hurt more people, and less chance of facing negative consequences when they do.

[–] [email protected] 17 points 10 months ago (23 children)

They're not hallucinations. People are getting very sloppy with terminology. Google's AI is summarizing the content of web pages that search is returning, if there's weird stuff in there then that shows up in the summary.

[–] [email protected] 19 points 10 months ago* (last edited 10 months ago)

You're right that they arent hallucinations.
The current issue isn't just summarized web page, its that the model for gemini is all of reddit. And because it only fakes understanding context, it takes shitposts as truth.

The trap is that reddit is maybe 5% useful content and the rest is shitposts and porn.

load more comments (22 replies)
[–] [email protected] 16 points 10 months ago (1 children)

Tinfoil hat time. Do you think Google intended this to work well? Or are we talking a lot more about Google and LLMs than we would have otherwise?

load more comments (1 replies)
[–] [email protected] 14 points 10 months ago* (last edited 10 months ago) (1 children)

Ah, so it only affects searching from the US for now. I already wondered why I couldn't reproduce the stuff I saw here and why I didn't really see a change at my Google results.

[–] [email protected] 25 points 10 months ago

You probably live in one of those "socialist" countries that has, like, consumer protection laws and stuff.

load more comments
view more: next ›