hendrik

joined 10 months ago
MODERATOR OF
[–] [email protected] 1 points 1 week ago* (last edited 1 week ago)

I'm always a bit unsure about that. Sure AI has a unique perspective on the world, since it has only "seen" it through words. But at the same time these words conceptualize things, there is information and models stored in them and in the way they are arranged. I believe I've seen some evidence, that AI has access to the information behind language, when it applies knowledge, transfers concepts... But that's kind of hard to judge. I mean an obvious example is translation. It knows what a cat or banana is. It picks the correct french word. At the same time it also maintains tone, deals with proverbs, figures of speech... And that was next to impossible with the old machine translation services which only looked at the words. And my impression with doing computer coding or creative writing is, it seems to have some understanding of what it's doing. Why we do things a certain way and sometimes a different way, and what I want it to do.

I'm not sure whether I'm being too philosophical with the current state of technology. AI surely isn't very intelligent. It certainly struggles with the harder concepts. Sometimes it feels like its ability to tell apart fact and fiction is on the level of a 5 year old who just practices lying. With stories, it can't really hint at things without giving it away openly. The pacing is off all the time. But I think it has conceptualized a lot of things as well. It'll apply all common story tropes. It loves to do sudden plot twists. And next to tying things up, It'll also introduce random side stories, new characters and dynamics. Sometimes for a reason, sometimes it just gets off track. And I've definitely seen it do suspension and release... Not successful, but I'd say it "knows" more than the words. That makes me think the concepts behind storytelling might actually be somewhere in there. It might just lack the needed intelligence to apply them properly. And maintain the bigger picture of a story, background story, subplots, pacing... I'd say it "knows" (to a certain degree), it's just utterly unable to juggle the complexity of it. And it hasn't been trained with what makes a story a good one. I'd guess, that might not be a fundamental limitation of AI, though. But more due to how we feed it award-winning novels next to lame Reddit stories without a clear distinction(?) or preference. And I wouldn't be surprised if that's one of the reasons why it doesn't really have a "feeling" of how to do a good job.

Concerning OP's original question... I don't think that's part of it. The people doing the training have put in deliberate effort to make AI nice and helpful. As far as I know there's always at least two main steps in creating large language models. The first one is feeding large quantities or text. The result of that is called a "base model". Which will be biased in all the ways the learning datasets are. It'll do all the positivity, negativity, stereotypes, be helpful or unhelpful roughly like people on the internet are, the books and wikipedia, which went in, are. (And that's already more towards positive.) The second step is to tune it for some application. Like answering questions. That makes it usable. And makes it abide by whatever the creators chose. Which likely includes not being rude or negative to customers. That behaviour gets suppressed. If OP wants it a different way, they probably want a different model, or maybe a base model. Or maybe a community-made fine-tune that has a third step on top to re-align the model with different goals.

[–] [email protected] 4 points 1 week ago* (last edited 1 week ago) (2 children)

That's a very common issue with a lot of large language models. You can either pick one with a different personality, (I liked Mistral-Nemo-Instruct for that, since it's pretty open to just pick up on my tone and go with that). Or you give clear instructions what you expect from it. What really helps is to include example text or dialogue. Every model will pick up on that to some degree.

But I feel you. I always dislike ChatGPT due to its know-it-all and patronizing tone. Most other models also are deliberately biased. I've tried creative writing and most refuse to be negative or they'll push towards an happy end. They won't write you a murder mystery novel without constantly lecturing about how murder is wrong. And they can't stand the tension and want to resolve the murder right away. I believe that's how they've been trained. Especially if there is some preference optimization been done for chatbot applications.

Utimately, it's hard to overcome. People want chatbots to be both nice and helpful. That's why they get deliberately biased toward that. Stories often include common tropes. Like resolving drama and a happy ending. And AI learns a bit from argumentative people on the internet, drama on Reddit etc. But generally that "negativity" gets suppressed so the AI doesn't turn on somebody's customers or spews nazi stuff like the early attempts did. And Gemma3 is probably aimed at such commercial applications, it's instruct-tuned and has "built-in" safety. So I think all of that is opposed to what you want it to do.

[–] [email protected] 2 points 1 week ago* (last edited 1 week ago)

I think it needs to work across instances, since we're concerned wit the Fediverse and federation is one of the defining mechanics. Also when I have a look at my subscriptions, they come from a variety of instances. So I don't think a single instance feature would be of any use for me.

Sure. And with the cosine similarity, you'd obviously need to suppress already watched videos. Obviously I watched them and the algorithm knows, but I'd like it to recommend new videos to me.

[–] [email protected] 2 points 1 week ago* (last edited 1 week ago)

Maybe your friend is right? Don't we all regularly fail to empathize with people? I don't get why people vote for certain people, I don't know 100% how it feels to be a woman, someone else... I don't know how an ilness feels if I never had it... That's perfectly normal. The thing hat matters if we respect such people (despite not understanding them).

[–] [email protected] 9 points 1 week ago* (last edited 1 week ago)

I'd say ignore your friend's opinion, she isn't your main concern. Talk to someone and get help. An adult, relative, friend... Or call one of the phone help lines, maybe a trustworthy teacher. I think any of that would maybe have a chance to change the situation. And seems this already starts to drag down on your relationships with other people. So you might want to do it.

So if you have someone in your life who sides with you, start with them and talk about your situation and how you feel. Otherwise... I'm not sure how legit they are, but there is https://www.childhelphotline.org/ if you're in the USA. You could ask them what to do if you feel your upbringing is bordering on abuse.

[–] [email protected] 1 points 2 weeks ago* (last edited 2 weeks ago) (1 children)

What do you mean? The Chinese are known for government-coordinated megaprojects... They regularly build entire city districts pretty much over night. And it's not really quick... They've been at it since almost 20 years. And I believe in 2016 they released their national 15-year plan to ramp up power plants and AI in order to become the global AI leader by 2030.

We can see how in the times before AI, they were able to build large Bitcoin farms quickly (before they banned it) and by today, their AI industry publishes quite some models, papers... So I don't really see a reason to question this. Or is there anything I've missed?

[–] [email protected] 3 points 2 weeks ago* (last edited 2 weeks ago)

I'm not sure if the title is clickbait... Because that's not in the following text. The article says they want to ban Nvidia from selling more hardware to them. It doesn't say anything about limiting availability of the service or anything.

If they do, my best guess is they do it like with TikTok. Change their stance on everything several times and then they don't really enforce anything.

[–] [email protected] 13 points 2 weeks ago* (last edited 2 weeks ago)

I've always backed up my SMS to my E-Mail inbox. With something like SMS Gate or SMS Backup+. I think it's nice to have all messages in my mail program. Of course that only does one way. To reply and get immediate notifications, I use KDEConnect (or GSConnect which is the same thing for GNOME.)

[–] [email protected] 6 points 2 weeks ago

Wasn't "error-free" one of the undecidable problems in maths / computer science? But I like how they also pay attention to semantics and didn't choose a clickbaity title. Maybe I should read the paper, see how they did it and whether it's more than an AI agent at the same intelligence level guessing whether it's correct. I mean surprisingly enough, the current AI models usually do a good job generating syntactically correct code one-shot. My issues with AI coding usually start to arise once it gets a bit more complex. Then it often feels like poking at things and copy-pasting various stuff from StackOverflow without really knowing why it doesn't deal with the real-world data or fails entirely.

[–] [email protected] 4 points 2 weeks ago* (last edited 2 weeks ago)

I've also had that. And I'm not even sure whether I want to hold it against them. For some reason it's an industry-wide effort to muddy the waters and slap open source on their products. From the largest company who chose to have "Open" in their name but oppose transparency with every fibre of their body, to Meta, the curren pioneer(?) of "open sourcing" LLMs, to the smaller underdogs who pride themselves with publishing their models that way... They've all homed in on the term.

And lots of the journalists and bloggers also pick up on it. I personally think, terms should be well-defined. And open-source had a well-defined meaning. I get that it's complicated with the transformative nature of AI, copyright... But I don't think reproducibility is a question here at all. Of course we need that, that's core to something being open. And I don't even understand why the OSI claims it doesn't exist... Didn't we have datasets available until LLaMA1 along with an extensive scientific paper that made people able to reproduce the model? And LLMs aside, we sometimes have that with other kinds of machine learning...

(And by the way, this is an old article, from end of october last year.)

[–] [email protected] 5 points 2 weeks ago (3 children)

Reportedly, they've built a ton of extra AI datacenters they don't even use. I thought they were just misappropriating government funds, but maybe that was an intelligent strategy. I wonder if that's enough to bridge the gap until they have their own silicon in mass production.

view more: ‹ prev next ›