LocalLLaMA

2747 readers

60 users here now

Welcome to LocalLLama! This is a community to discuss local large language models such as LLama, Deepseek, Mistral, and Qwen.

Get support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.

As ambassadors of the self-hosting machine learning community, we strive to support eachother and share our enthusiasm in a positive constructive way.

founded 2 years ago

MODERATORS

SkySyrup@sh.itjust.works

pax@sh.itjust.works

noneabove1182@sh.itjust.works

Smokeydope@lemmy.world

MonsterBug@sh.itjust.works

Mistral small 3.1 released (mistral.ai)

submitted 5 days ago by NinjaMoves@feddit.nu to c/localllama@sh.itjust.works

5 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] obbeel@lemmy.eco.br 6 points 5 days ago

A GPT-4o-mini comparable system that you can run on a RTX 4090 isn't going to solve direct problems, but it might have enterprise uses. Text generation automation for personal use should be strong, for example - in place of having a third party API do it.