sntx

joined 2 years ago
[–] sntx@lemm.ee 2 points 1 month ago

Or about half a year if we're only counting the time during which I've been alive.

[–] sntx@lemm.ee 3 points 1 month ago (1 children)

13.787 ± 0.020 billion years

[–] sntx@lemm.ee 2 points 1 month ago (1 children)

Why does look like another bot post?

[–] sntx@lemm.ee 4 points 1 month ago (1 children)

The simlutation terminates.

[–] sntx@lemm.ee 3 points 1 month ago (2 children)

I'm curious, how do you run the 4x3090s? The FE Cards would be 4x3=12 PCIe slots and 4x16=64 PCIe lanes... Did you nvlink them? What about transient power spikes? Any clock or even VBIOS mods?

[–] sntx@lemm.ee 4 points 1 month ago (2 children)

I'm also on p2p 2x3090 with 48GB of VRAM. Honestly it's a nice experience, but still somewhat limiting...

I'm currently running deepseek-r1-distill-llama-70b-awq with the aphrodite engine. Though the same applies for llama-3.3-70b. It works great and is way faster than ollama for example. But my max context is around 22k tokens. More VRAM would allow me more context, even more VRAM would allow for speculative decoding, cuda graphs, ...

Maybe I'll drop down to a 35b model to get more context and a bit of speed. But I don't really want to justify the possible decrease in answer quality.

[–] sntx@lemm.ee 2 points 2 months ago

I'm running such a setup!

This is my nixos config, though feel free to ignore it, since it's optmized for me and not others.

How did I achieve your described setup?

  • nixos + flakes & colmena: Sync system config & updates
  • impermanence through btrfs snapshots: destroy all non-declarative state between reboots to avoid drift between systems
  • syncthing: synchronise ALL user files between systems (at least my server is always online to reduce sync inconsistencies from only having a single device active at the time)
  • rustic: hourly backups from all devices to the same repos, since this is deduplicated and my systems are mostly synchronised, I have a very clear record of my file histories
[–] sntx@lemm.ee 5 points 2 months ago

The added info from pv is also nice ^^

[–] sntx@lemm.ee 4 points 2 months ago
[–] sntx@lemm.ee 3 points 2 months ago
[–] sntx@lemm.ee 3 points 3 months ago

I would use it as a Total Perspective Vortex and dump the scale of the universe into my mind.

[–] sntx@lemm.ee 1 points 3 months ago

I like the reading tip! I think not many people are aware of it.

My thoughts use meaning, instead a specific words.

The whole interpreting my thoughts as natural language often takes longer than coming up with the tought itself.

This results in:

  1. I often use the intersection of the languages I, and the people I speak with know.
  2. When it's a topic I'm knowledgeable about, I often talk too fast and people find it hard to follow me.
  3. I draw many associations and comprehending the larger picture is easy. Yet I often miss the point in the smaller picture.
view more: ‹ prev next ›