this post was submitted on 23 Apr 2025
6 points (100.0% liked)

Artificial Intelligence

1609 readers
26 users here now

Welcome to the AI Community!

Let's explore AI passionately, foster innovation, and learn together. Follow these guidelines for a vibrant and respectful community:

You can access the AI Wiki at the following link: AI Wiki

Let's create a thriving AI community together!

founded 2 years ago
MODERATORS
[email protected]
6
LLMs Can Think While Idle: Researchers from Letta and UC Berkeley Introduce ‘Sleep-Time Compute’ to Slash Inference Costs and Boost Accuracy Without Sacrificing Latency (www.marktechpost.com)
submitted 1 month ago by [email protected] to c/[email protected]
3 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 1 points 3 weeks ago (1 children)

i mean…

your brain essentially does this it’s just that compute and memory are one system and it is as physically optimized as possible in brain systems.

this strategy is less stupid than it sounds if you abandon von neumann purism imo

it can be more efficient than just waiting for the input and inferring once based on that… you are an example of this in real life.

[–] [email protected] 1 points 3 weeks ago

faster != more efficient. And you cannot compare brains to computers. Speculative execution improves speed in the cpu, at the cost of efficiency