this post was submitted on 02 Mar 2025
27 points (100.0% liked)
LocalLLaMA
2775 readers
25 users here now
Welcome to LocalLLama! This is a community to discuss local large language models such as LLama, Deepseek, Mistral, and Qwen.
Get support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.
As ambassadors of the self-hosting machine learning community, we strive to support eachother and share our enthusiasm in a positive constructive way.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
They haven’t released the models yet, but seem to suggest they will as Apache licensed. The voice models are in 1B/3B/8B sizes, so that sounds relatively reasonable for consumer hardware.
Yeah that roughly translates to GB vram, but with quantization and stuff it gets more complicated.
Sounds pretty applicable tho in these sizes ^^