this post was submitted on 11 Oct 2023
505 points (92.7% liked)

Technology

69913 readers
2078 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 3 points 2 years ago (2 children)

Wait, you guys don't already have hundreds of gigabytes of memory?

[–] [email protected] 7 points 2 years ago

Technically I could upgrade my desktop to 192GB of memory (4x48). That's still only about half the amount required for the largest BLOOM model, for instance.

To go beyond that today, you'd need to move beyond the Intel Core or AMD Ryzen platforms and get something like a Xeon. At that point you're spending 5 figures on hardware.

I know you're just joking, but figured I'd add context for anyone wondering.

[–] [email protected] 2 points 2 years ago (1 children)

Don't worry about the RAM. Worry about the VRAM.

[–] [email protected] 4 points 2 years ago

Google drive is my swap space