this post was submitted on 02 Apr 2025
41 points (100.0% liked)

LocalLLaMA

3306 readers
1 users here now

Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.

Get support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.

As ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.

Rules:

Rule 1 - No harassment or personal character attacks of community members. I.E no namecalling, no generalizing entire groups of people that make up our community, no baseless personal insults.

Rule 2 - No comparing artificial intelligence/machine learning models to cryptocurrency. I.E no comparing the usefulness of models to that of NFTs, no comparing the resource usage required to train a model is anything close to maintaining a blockchain/ mining for crypto, no implying its just a fad/bubble that will leave people with nothing of value when it burst.

Rule 3 - No comparing artificial intelligence/machine learning to simple text prediction algorithms. I.E statements such as "llms are basically just simple text predictions like what your phone keyboard autocorrect uses, and they're still using the same algorithms since <over 10 years ago>.

Rule 4 - No implying that models are devoid of purpose or potential for enriching peoples lives.

founded 2 years ago
MODERATORS
 

Every release from kobold has me hyped one of the nicest engines that balances cutting edge features with ease of use and optimization. This is gonna be a great year for LocalLLaMA Hype :)

https://github.com/LostRuins/koboldcpp/releases

all 11 comments
sorted by: hot top controversial new old
[–] [email protected] 12 points 3 months ago (1 children)

Why's it always gotta be creepy furry shit though?

[–] [email protected] 14 points 3 months ago (1 children)

Furries keep the world running, like it or not.

[–] [email protected] 5 points 3 months ago (1 children)
[–] [email protected] 4 points 3 months ago

I'm more of a Tux fanboy

[–] [email protected] 9 points 3 months ago (1 children)

Love the update, but this mascot better not stir anything within me.

[–] [email protected] 9 points 3 months ago* (last edited 3 months ago)

What?? Nooo of course not. I mean who would even have things to awaken in the first place, that would be crazy am I right? Not you or me thats for sure. Anyways all im saying is that whatever happens between you and your local kobold stays between you two. Everyone is welcome to come now and join LocalLLaMA today!

Ooops, looks like someone acidentally dropped all these unrelated pictures under my comment just now. Oh well, better leave them all here in case they come back for them.

[–] [email protected] 2 points 2 months ago

Oh hey I'm late to the party but, uhh... anyone wanna sign a union card?

[–] [email protected] 1 points 2 months ago (1 children)

Is the KoboldCPP UI a bit better these days? Or maybe it's best to hook it up as an OpenAI connection via OpenWebUI... I mostly use it with ollama.

[–] [email protected] 1 points 2 months ago (1 children)

I don't know how old the last version of kobold you used was or what it looked like. The newest verion has a couple different web UI themes to pick from in settings, the basic one has more buttons for easier editing, the corpo one is pretty sleek for phones and tablets. They finally have a terminal mode if you are running on headless servers.

[–] [email protected] 1 points 2 months ago (1 children)

@[email protected] I was using it like a year and a half ago. With the web UI that looks like it's from 2008 lol. But I think at this point, I'd use it for the OpenAI compatible endpoint anyway.