It also really depends on VRAM IMO, I have a 4090 and these days I don't tend to touch anything under 30B (Wizard Uncensored is really good here) if I had dual 3090s I would likely be running a 65B model.
ThrowsArrows
joined 2 years ago
It also really depends on VRAM IMO, I have a 4090 and these days I don't tend to touch anything under 30B (Wizard Uncensored is really good here) if I had dual 3090s I would likely be running a 65B model.
On my most active Pi 4B I run docker with: Bazarr Doplarr Foundry VTT Jacket Overseer Plex Portainer Radarr Sonarr Syncthing Transmission through VPN
You can do a lot with these little things
Edit: missed an r