TechTakes

2057 readers

458 users here now

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

founded 2 years ago

MODERATORS

[email protected]

226

Only 3%* of US AI users are willing to pay a penny for it (pivot-to-ai.com)

submitted 1 week ago* (last edited 1 week ago) by [email protected] to c/[email protected]

105 comments fedilink hide all child comments

podcast version
video version

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 1 points 6 days ago* (last edited 6 days ago) (3 children)

Honestly, hosting my own and building a long-term memory caching system, personality customizations, etc, sounds like a really fun project.

Edit: Is ChatGPT downvoting us? 😂

[–] [email protected] 9 points 6 days ago* (last edited 6 days ago)

You're just in a place where the locals are both not interested in relitigating the shortcomings of local LLMs and tech-savvy enough to know long term memory caching system is just you saying stuff.

Hosting your own model and adding personality customizations is just downloading ollama and inputting a prompt that maybe you save as a text file after. Wow what a fun project.

[–] [email protected] 9 points 6 days ago (1 children)

no, you fuckers wandered into an anti-AI community and started jacking off about local models

[–] [email protected] 1 points 6 days ago (1 children)

It's a factual statement regardless of what you think of AI. People won't pay for something if the free option that can't be taken away from them is just as good.

Maybe that will at some point kill off the big overvalued companies

[–] [email protected] 11 points 6 days ago

what the numbers show is that nobody gives a shit. nobody’s paying for LLMs and nobody’s running the models locally either, because none of it has a use case. masturbating in public about how invested you are in your special local model changes none of this.

[–] Fedegenerate 1 points 6 days ago (2 children)

Tonight, I installed Open Web UI to see what sort of performance I could get out of it.

My entire homelab is a single n100 mini, so it was a bit of squeeze to add even Gemma3n:e2b onto it.

It did something. Free chatgpt is better performance, as long as I remember to use place holder variables. At least for my use case: vibe coding compose.yamls and as a rubber duck/level 0 tech support for trouble shooting. But it did something, I'm probably going to re-test when I upgrade to 32gb of ram, then nuke the LXC and wait till I have a beefier host though.

[–] [email protected] 4 points 5 days ago

it was a bit of squeeze to add even Gemma3n:e2b onto it

statements dreamed up by the utterly deranged

[–] [email protected] 7 points 6 days ago (1 children)

case in point: you jacked off all night over your local model and still got a disappointing result

[–] Fedegenerate 1 points 6 days ago

Not really. The fact that an n100 can produce anything at all is awesome.