this post was submitted on 04 Feb 2025
18 points (100.0% liked)

LocalLLaMA

2825 readers
27 users here now

Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.

Get support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.

As ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.

founded 2 years ago
MODERATORS
top 6 comments
sorted by: hot top controversial new old
[–] DavidGarcia@feddit.nl 6 points 2 months ago

True, but the newest mistral model is already pretty great

[–] hendrik@palaver.p3x.de 3 points 2 months ago* (last edited 2 months ago) (1 children)

By the way: People have started questioning the numbers. Seems it's not super clear whether Deepseek told the truth. And IMO the implications aren't that clear either. If you can do the final training run of a singular model for $5 million... It still might require your parent company to build a datacenter for $1.6 billions and then rent the GPUs to you for $2 an hour. So it's not like Europe can cough up a few millions and compete with OpenAI.

(German article here. But all of this is more speculation than anything else. At least as of now: https://www.heise.de/news/DeepSeek-V3-Entwicklung-soll-viel-teurer-gewesen-sein-10267750.html )

[–] Eyekaytee@aussie.zone 4 points 2 months ago (1 children)
[–] hendrik@palaver.p3x.de 1 points 2 months ago (1 children)

Are those proposals, or are they being built, or running already?

[–] Eyekaytee@aussie.zone 2 points 2 months ago* (last edited 2 months ago) (1 children)

I think they need to be built still tbh

but i don't think this will be a fix, there are more structural issues in the EU

EU is behind on chip making, software, space race, EV's, AI, etcetc

They will continue to be behind China and America so long as it's more difficult to do business and more difficult to raise money

[–] hendrik@palaver.p3x.de 2 points 2 months ago* (last edited 2 months ago)

Agreed. And I'd argue all of this needs to be addressed in the short term. I live in Germany and we massively rely on other countries. Not only because our economy exports a lot of goods and we want other people to buy them... But also because we used to rely on cheap Russian natural gas. We've moved manufacturing and production into countries like China where labor is cheap. We get our big-tech, every day social media platforms and a lot of culture from the USA...

All of that was a good choice to get nice, cheap things. But it's not sustainable any more. I think we have to ramp up research, manufacturing and a few other things fast. It hurts me, because I think humanity should all pull in the same direction. But I think it's time to face reality, grow up and become able to sustain ourselves. If things escalate, our economy needs to be able to handle that. And Europe also needs to closely work together politically, so it's 750 million people standing united and strong. I don't see any other entity advocating for sharing and working together... Either we start to be responsible for our ideals and technology, or we'd need to do away with them.

I just hope we'll do that. And find a sane approach. We can't also become imperialists ourselves. I think we need to be better than that.