this post was submitted on 25 Feb 2025
13 points (100.0% liked)

Free Open-Source Artificial Intelligence

3306 readers
2 users here now

Welcome to Free Open-Source Artificial Intelligence!

We are a community dedicated to forwarding the availability and access to:

Free Open Source Artificial Intelligence (F.O.S.A.I.)

More AI Communities

LLM Leaderboards

Developer Resources

GitHub Projects

FOSAI Time Capsule

founded 2 years ago
MODERATORS
 

Hello, I am currently using codename goose as an AI client to proofread and help me with coding. I have it setup towards Googles Gemini, however I find myself quickly running out of tokens with large files. I was wondering if there are any easy way to self host an AI with similar capabilites but still have access to read and write files. I've tried both ollama and Jan, but neither have access to my files. Any recommendations?

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 1 points 3 days ago

Do you think a 24GB card like the 7900 XTX could run Mistral Small? TBH that card is nowhere to be found right now