this post was submitted on 24 Jan 2025
32 points (100.0% liked)

Free Open-Source Artificial Intelligence

3306 readers
2 users here now

Welcome to Free Open-Source Artificial Intelligence!

We are a community dedicated to forwarding the availability and access to:

Free Open Source Artificial Intelligence (F.O.S.A.I.)

More AI Communities

LLM Leaderboards

Developer Resources

GitHub Projects

FOSAI Time Capsule

founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 1 points 2 months ago

My old computer and laptop run 13B models at 2 - 3 tokens a second on CPU only. That's a bit slower than I can read. I wonder what my new phone does.