this post was submitted on 23 Mar 2025
786 points (100.0% liked)

Technology

68130 readers
5449 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

A Norwegian man said he was horrified to discover that ChatGPT outputs had falsely accused him of murdering his own children.

According to a complaint filed Thursday by European Union digital rights advocates Noyb, Arve Hjalmar Holmen decided to see what information ChatGPT might provide if a user searched his name. He was shocked when ChatGPT responded with outputs falsely claiming that he was sentenced to 21 years in prison as "a convicted criminal who murdered two of his children and attempted to murder his third son," a Noyb press release said.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 9 points 1 week ago (9 children)

hallucinations

It's called libel.

[–] [email protected] 15 points 1 week ago* (last edited 1 week ago) (8 children)

Surely you jest because it’s so clearly not if you understand how LLMs work (at the core it’s a statistic model - and therefore all approximation to a varying degree).

But great can come out of this case if it gets far enough.

Imagine the ilk of OpenAI, Google, Anthropic, XAI, etc. being forced to admit that an LLM can’t actually do anything but generate approximations of language. That these models (again LLMs in particular) produce approximations of language that are so good they’re often indistinguishable from the versions our brains approximate.

But at the core they cannot produce facts because the way they are made includes artificially injected randomness layered on-top of mathematically encoded values that merely get expressed as tiny pieces of language (tokens) - ones that happen to be close to each other in a massively multidimensional vector space.

TLDR - they’d be forced to admit the emperor has no clothes and that’s a win for everyone (except maybe this one guy).

Also it’s worth noting I use LLMs for work almost daily and have studied them quite a bit. I’m not a hater on the tech. Only the capitalists trying to force it down everyone’s throat in such a way that we blindly adopt it for everything.

[–] [email protected] 4 points 1 week ago (5 children)

this is confusing. did you think I meant you're engaging in libel against llms or something? that's the only way I can make sense of your reply.

[–] [email protected] 7 points 1 week ago* (last edited 1 week ago) (1 children)

Really?

I read your reply as saying the output is (can be) libellous - which it cannot be because it is not based on a dataset which resolves to anything absolute.

Maybe we’re just missing each other - struggling to parse each others’ output. ;)

[–] [email protected] 10 points 1 week ago* (last edited 1 week ago) (2 children)

well I must be missing something because all I'm getting is that you're saying it's full of shit as a defense against libel.

[–] [email protected] 3 points 1 week ago

So maybe we’re kinda staring at two sides of the same coin. Because yeah, you’re not misrepresentin my point.

But wait there’s a deeper point I’ve been trying to make.

You’re right that I am also saying it’s all bullshit - even when it’s “right”. And the fact we’d consider artificially generated, completely made up text libellous indicates to me that we (as a larger society) have failed to understand how these tools work. If anyone takes what they say to be factual they are mistaken.

If our feelings are hurt because a “make shit up machine” makes shit up… well we’re holding the phone wrong.

My point is that we’ve been led to believe they are something more concrete, more exact, more stable, much more factual than they are — and that is worth challenging and holding these companies to account for. i hope cases like these are a forcing function for that.

That’s it. Hopefully my PoV is clearer (not saying it’s right).

[–] [email protected] 2 points 1 week ago (1 children)

Technically, in some jurisdictions a person who is widely known to be unreliable is harder to sue for libel precisely because the likelihood of reputational injury is lower if nobody actually believes the claim.

[–] [email protected] 3 points 1 week ago

yeah but the companies pushing the ai themselves are definitely not marketing it as unreliable, otherwise it wouldn't have any purpose. they knowingly push these as actual ways to find out information while putting tiny disclaimers that things might not be accurate to avoid liability which shouldn't hold up in any sane court.

load more comments (3 replies)
load more comments (5 replies)
load more comments (5 replies)