I submitted a response but if i may give some feedback, the second portion brings up:
I am willing to pay a substantial amount for hardware required for self-hosting.
This seemed out of place because there were no other value related questions (iirc). Such as:
- I believe self hosting saves me money in the short term
- i believe self hosting saves me money in the long run
I'm sure you could also think of more. But i think it's pretty important because between cloud service providers and any non-free apps you want to use, it can be quite costly compared to the cost of some hardware and time it takes to set things up.
The rest of my responses don't change but if you're wanting to understand the impact of money in all of this, i think some more questions are needed
Best of luck!
There are cuda packages for arch. I can confirm they work.
https://wiki.archlinux.org/title/GPGPU
Edit- to add i haven't found arch's limit, it feels like i am bound only by my own limit in my time, ability, and willingness to tinker with my setup. arch itself is widely supported, it has many official packages through pacman, and then additional through the "arch user repository" (AUR) so chances are most of the things you want or need have a package that can be installed with an AUR helper (like yay/paru which install from both pacman and AUR). In other distros you get more of a one-size fits all and you lose some of that ability to change things whereas arch you're giving a minimal setup and left to build the system to your liking. It does take more time and expertise than other distros but it does give you more control. For me the trade off was an easy decision, but it's not something i blanket recommend to everyone.