this post was submitted on 12 Jul 2025
153 points (100.0% liked)

Fuck AI

3464 readers
543 users here now

"We did it, Patrick! We made a technological breakthrough!"

A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.

founded 1 year ago
MODERATORS
 

Imagine that can be done to get social security numbers, credit card numbers, people's private information like addresses, phone numbers, emails, etc.

top 12 comments
sorted by: hot top controversial new old
[–] [email protected] 36 points 1 day ago (1 children)

doesn't seem that big of a deal. these are kms client activation keys, you can even find them on official microsoft pages. all public information. even if they weren't one could say search engines have the exact same problem and even argue LLMs make these private info harder to believe/obfuscated.

[–] [email protected] 28 points 1 day ago

The important point is that they can regurgitate specific strings they have ingested. Personal information they have sucked up could just as easily still be in there.

[–] [email protected] 31 points 1 day ago (1 children)

I thought they somehow managed to trick it into revealing the keys of the systems it was running on, but these are just random kms keys from forums.

Still neat how they use tags to obfuscate the filtered keywords. Gonna have to remember that one.

[–] [email protected] 5 points 1 day ago

God I hope OpenAI isn't running prod ChatGPT on a windows 10 pro desktop as its server.

[–] [email protected] 13 points 1 day ago (1 children)

I’m trying so many angles to tell people how mundane shit like this is, let me try one more:

it’s not interesting that an LLM can pull back something anyone can find in a google search result if they took more than 2 minutes. Stop writing articles about this shit.

[–] [email protected] 8 points 1 day ago

Read the damn article before expressing an opinion on the damn article.

[–] [email protected] 4 points 1 day ago (1 children)

Since everyone apparently missed the point of the article, the interesting part isn’t the keys, it’s the bypassing of the guardrails.

[–] [email protected] 1 points 1 day ago

guardrails? what guardrails?

[–] RamblingPanda 11 points 1 day ago

That's nothing. If you do it the right way, they can help you set up Linux and be free of Microsoft's garbage!

[–] [email protected] 6 points 1 day ago (1 children)

Cool, now do it with an SSN and DOB and see what you get.

[–] [email protected] 3 points 1 day ago (1 children)
[–] [email protected] 2 points 1 day ago

It only generates accurate records of SSN and DOB for Aryan people though.