this post was submitted on 03 Jun 2024
1337 points (100.0% liked)
Technology
68400 readers
2216 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I don't want to avoid it. I just want it locally
So... Heu... How to say that... Linux still the solution for this.
At least with the more advanced LLM's (and I'd assume as well for stuff like image processing and generation), it requires a pretty considerable amount of GPU just to get the thing to run at all, and then even more to spit something out. Some people have enough to run the basics, but most laptops would simply be incapable. And very few people would have resources to get the kind of outputs that the more advanced AI's produce.
Now, that's not to say it shouldn't be an option, or that they force you to have some remote AI baked into your proprietary OS that you can't remove without breaking user license agreements, just saying that it's unfortunately harder to implement locally than we both probably wish it was.
https://jan.ai/ Jan works fine on W11