this post was submitted on 23 Mar 2025
786 points (100.0% liked)

Technology

68066 readers
3458 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

A Norwegian man said he was horrified to discover that ChatGPT outputs had falsely accused him of murdering his own children.

According to a complaint filed Thursday by European Union digital rights advocates Noyb, Arve Hjalmar Holmen decided to see what information ChatGPT might provide if a user searched his name. He was shocked when ChatGPT responded with outputs falsely claiming that he was sentenced to 21 years in prison as "a convicted criminal who murdered two of his children and attempted to murder his third son," a Noyb press release said.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 10 points 1 week ago (5 children)

Maybe people need to learn that AI hallucinates

[–] [email protected] 8 points 1 week ago (1 children)

you misspelled "is fucking wrong all the goddamn time"

[–] [email protected] 4 points 1 week ago (1 children)

It would be more accurate to say that rather than knowing anything at all they have a model of the statistical relationship between a series of tokens and subsequent tokens which words are apt to follow other words and because the training set contains many true things the words produced in response to queries often contain true statements and almost always contain statements that LOOK like true statements.

Since it has no inherent model of the world to draw on and only such statistical relationships you should check anything important

[–] [email protected] 4 points 1 week ago (1 children)

you say more accurate but all I see is a very roundabout way of saying fucking wrong all the goddamn time

[–] [email protected] 2 points 1 week ago (1 children)

it produces things that appear to be cohesive sentences. there is no reason to assign correctness to a sentence.

[–] [email protected] 3 points 1 week ago

maybe you should tell that to the companies that shove it in every crevice of every website and app. why is it on search results? why is it summarizing emails? why is it literally doing anything? it's useless. actually it's less than useless. it's misleading and harmful. and the companies should be held liable for it.

[–] zipzoopaboop 6 points 1 week ago (1 children)

Maybe the owners of LLMs need to be held responsible for the problematic software they release

[–] [email protected] 2 points 1 week ago* (last edited 1 week ago)

There's no problem here. User error

[–] [email protected] 5 points 1 week ago (2 children)

So then what's the use of the program if it uses a bunch of energy to just make shit up?

[–] [email protected] 5 points 1 week ago

sometimes you need a machine that makes things up according to a given specification.

[–] [email protected] 2 points 1 week ago (1 children)

Because it makes up things that are 99% correct and in some areas the 99% + verification and expansion can be superior time wise to the 100% manual route

[–] [email protected] 3 points 1 week ago (1 children)

What models are youseeing where things are 99% correct? Google's search chat bot can't even keep Windows vs Mac hotkey commands straight.

[–] [email protected] 1 points 1 week ago

it's pretty good a getting grammar correct.

[–] [email protected] 5 points 1 week ago

Yea, I’m mind blown, how, after 3 years people still don’t know how to use LLM effectively in use cases they bring value (by reducing work time)

  • start a second chat and ask different to verify
  • if you use chatGPT reason feature, read reasoning output as well!
  • best search for verifiable thing, like code, that you can run or similar
  • if you use it for research, only trust the info, if it used web search and you have read the webpages it used to summarise as well, or use traditional web search to verify based on the output
  • it is great to manipulate text until sounds as desired (if you are not good in wording stuff anyway)
  • plan what steps to do in a project next (like “i want to do xxx have y and need it to be z, make me a list of todos)
  • and of course it is great to generate simple python scripts fast (I often use it as my python writing slave)

Using AI like this, helped me enormously in work and live Like, I learned a lot C, C++, how linux kernel modules work, how PO/POT works, helped me with translations, introduced me into music production, helped me set up appFlowy and general windows/linux issues.

[–] [email protected] 3 points 1 week ago (1 children)

And when it hallucinates harmful things, protections need to be put onto the output.

[–] [email protected] 4 points 1 week ago (1 children)

Ok so explain particularly what this means

[–] [email protected] 5 points 1 week ago (1 children)

If you have a service, and that service is generating things that harm people, you should have to stop it.

[–] [email protected] 3 points 1 week ago (1 children)

We value the gains both immediate and presumed more than the harm

[–] [email protected] 1 points 1 week ago

Surely. Otherwise it'd be shut down. Like they did with my gun machine :-(