this post was submitted on 04 Jun 2024
100 points (100.0% liked)

Selfhosted

45542 readers
1487 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 2 years ago
MODERATORS
 

I'm in the process of wiring a home before moving in and getting excited about running 10g from my server to the computer. Then I see 25g gear isn't that much more expensive so I might was well run at least one fiber line. But what kind of three node ceph monster will it take to make use of any of this bandwidth (plus run all my Proxmox VMs and LXCs in HA) and how much heat will I have to deal with. What's your experience with high speed homelab NAS builds and the electric bill shock that comes later? Epyc 7002 series looks perfect but seems to idle high.

top 50 comments
sorted by: hot top controversial new old
[–] [email protected] 28 points 10 months ago

My pi costs probably around 20 a year lol.

[–] [email protected] 19 points 10 months ago (4 children)

I've got a 3 node Proxmox/ceph cluster with 10G, plus a separate Nas. They are all rack mount with dual PSU. Add in the necessary switching, and my average load is about 800w. Throw my desktop (also on 10G) into the mix and it runs 1.1kw.

That's roughly $50-60 extra in electricity costs for me monthly.

[–] [email protected] 16 points 10 months ago (1 children)

Would be around 300€ in Germany, on a cheap contract. Limiting myself to one combined NAS/application server atm, with the others turned on only if I want to try sth out.

load more comments (3 replies)
[–] [email protected] 15 points 10 months ago* (last edited 10 months ago) (3 children)

Around 100 Watts for

  • NAS with 4x3.5" HDD,
  • Minisforum HM90 for Proxmox with 2x2.5" HDDs,
  • 16 Port TP Link PoE Switch,
  • TP Link router
  • 2x Raspberry Pi 4b

But everything with gigabit speed. Doesnt need more at home

load more comments (3 replies)
[–] [email protected] 9 points 10 months ago* (last edited 10 months ago)

Acronyms, initialisms, abbreviations, contractions, and other phrases which expand to something larger, that I've seen in this thread:

Fewer Letters More Letters
AP WiFi Access Point
DHCP Dynamic Host Configuration Protocol, automates assignment of IPs when connecting to a network
DNS Domain Name Service/System
HA Home Assistant automation software
~ High Availability
LXC Linux Containers
NAS Network-Attached Storage
NUC Next Unit of Computing brand of Intel small computers
NVMe Non-Volatile Memory Express interface for mass storage
PCIe Peripheral Component Interconnect Express
PSU Power Supply Unit
PiHole Network-wide ad-blocker (DNS sinkhole)
PoE Power over Ethernet
RPi Raspberry Pi brand of SBC
SATA Serial AT Attachment interface for mass storage
SBC Single-Board Computer
SSD Solid State Drive mass storage
Unifi Ubiquiti WiFi hardware brand
VPS Virtual Private Server (opposed to shared hosting)

[Thread #782 for this sub, first seen 4th Jun 2024, 04:35] [FAQ] [Full list] [Contact] [Source code]

[–] [email protected] 9 points 10 months ago

I'm running my smart home entirely from a single NUC running proxmox with VMs and LXCs for my services. It's pulling ~7W on average

[–] [email protected] 9 points 10 months ago* (last edited 10 months ago) (1 children)

You most likely won't utilize these speeds in a home lab, but I understand why you want them. I do too. I settled for 2.5GBit because that was a sweet spot in terms of speed, cost and power draw. In total, I idle at about 60W for following systems:

  • Lenovo M90q (i7 10700, 32GB, 3 x 1 TB SSD) running Proxmox, 15W idle
  • Custom NAS (Ryzen 2400G, 16GB, 4x12TB HDD)v running Truenas (30W idle)
  • Firewall (N5105, 8GB) running OPNsense (8W idle)
  • FritzBox 6660 Cable, which functions as a glorified access point, 10W idle
[–] [email protected] 3 points 10 months ago

With 25 GbE, even 10, I'd be tempted to PXE boot client systems. Maybe still have a local PCIe SSD for windows game files.

Dunno how that would actually work with Windows, but it was fun when I did it for beowulf nodes. Setting RPis to netboot is a little involved, but you can create an OSMC image and give all your TVs a consistent 'smart' interface. You don't even need 10GbE to be pretty functional for the Pi, but my experience is that WiFi is not fast enough.

[–] [email protected] 7 points 10 months ago

125W (Less than $15/month) or so for

  • Ryzen 9 3900X
  • 64GB RAM
  • 2x4TB NVMe (ZFS Mirror)
  • 5x14TB HDD (ZFS RAID-Z2)
  • 2.5GBe Network Card
  • 5-port 2.5GBe Network Switch
  • 5-port 1GBe POE Network Switch w/ one Reolink Camera attached

I generally leave powerManagement.cpuFreqGovernor = "powersave" in my Nix config as well, which saves about 40W ($4/mo or so) for my typical load as best as I can tell, and I disable it if I'm doing bulk data processing on a time crunch.

[–] [email protected] 5 points 10 months ago (1 children)

My real server (Nextcloud/NAS/several more vm's) uses 28 Watts on average. In addition, there is one Pi 4B running, and I don't even know it's wattage.

I'm planning on replacing the real server with a new one, with lots of cores and approx. 50 Watts then.

[–] [email protected] 2 points 10 months ago

Pi4 tend to stick around 5w

[–] [email protected] 5 points 10 months ago

The load on my UPS is around 100-140 watts. That includes my server, firewall, switch, starlink and a unifi access point. I would love to get that power consumption down. I only get 4-5 hours of runtime on battery. Also, the room it's in is small and it gets really hot in the summer time.

[–] [email protected] 5 points 10 months ago

I have an ITX Ryzen 2700X with an arc A380. 3 HDDs and 1 SSD boot drive.

Before some kernel improvements for the A380, my idle wattage was 60W. Without the A380 it was around 35W idle. I am hoping that it is around 45W now because of fixing the high idle wattage of the GPU but I have to measure again.

Performance is great though. Perfect Jellyfin streaming, home automation, document and media management, file sync, recipe management, etc...

People tend to over-spec their servers, in my opinion. Unless you are dealing with more than a few dozen clients or so on one server (or having a many-user dedicated streaming server), you really don't need much.

[–] [email protected] 5 points 10 months ago (1 children)

5950x in an matx board with 15 x 3.5in drives 1 x sata sad 1 x optane u.2 drive (pulls like 10watts) 1 x Nvidia A2000 1 x Lsi 9305 16i 1 x 2.5gbe intel nic 3 x 140 mm fans at full tilt

Runs at like 120 watts at idle, like 220 watts with a good amount of work and peaks at like 320 watts if I make it do a lot of work

[–] [email protected] 4 points 10 months ago

I recently removed my 25Gbps PCIe dual port cards from my 2 servers because they were using 20W more. My entire rack including 2 UniFi PoE connections uses 90 W now (so 110 W just for having 25 Gpbs).

There is some heat from such cards, but usually it gets transported outside fine. The ones I bought did not come with a fan. I think you cannot operate them without one. The heat sinks get very hot.

[–] [email protected] 4 points 10 months ago* (last edited 10 months ago)

15w Raspberry pi 4 + HDDs

[–] [email protected] 4 points 10 months ago (2 children)

I run 3900X with a 40Gbit fiber, packed with HDDs and nvmes. The box fluctuates around 90-110W use.

load more comments (2 replies)
[–] [email protected] 4 points 10 months ago
  • Fujitsu motherboard
  • Intel pentium G5600
  • 6 HDD (4 x 4 TB 2 x 8 TB) spinned down
  • 2 SSD for proxmox
  • 6 CT and no VM for now

it runs at 16W mostly idle

[–] [email protected] 3 points 10 months ago* (last edited 10 months ago) (1 children)

The last time I checked, mine runs at about 5-10 watts usually.

  • Intel i7-3770
  • 16gb DDR3
  • 2 1TB SSDs
[–] [email protected] 8 points 10 months ago (1 children)

Are you sure. I was thinking those specs you would be more in the 50-80 watts range.

[–] [email protected] 2 points 10 months ago* (last edited 10 months ago)

Yep, my homeserver spends most of it's time idling, so power management kicks in.

Now when one of my build VMs are running, it'll get up to that range, but that's why I said it runs at 10 watts usually

[–] [email protected] 3 points 10 months ago* (last edited 10 months ago)

Mine is about 8W on average.

It's an Odroid H3 that runs Nextcloud, Jellyfin, AudiobookShelf, a bunch of websites and Home Assistant.

It has 2x Sata SSD's connected.

This setup is not high speed at all, so it's not what you asked about. I just answered the headline question. ;)

If any air ventilation fan turns on in the house it uses at least 3x that power, so I don't calculate the price on my servers power draw as it almost not noticable.

[–] [email protected] 3 points 10 months ago

Let's see...

My servers (tiny/mini/micros) in total are about... 600W or so. Two NASs, about 15-20W a piece.

I spend a out $150/mo in electricity, but my hot water/HVAC/etc are the big power draw. I'd say about $40-50/mo is what I'm spending on powering the servers in my office.

Definitely puts off some heat, but that's partially because it's all in one rack, and I've got a bunch of other work hardware in there. It's about 2 degrees warmer in my office than the rest of my home, but I also have air cycling all the time since it's a single unit HVAC and I need to keep the air moving to keep it all the right temp in the other rooms anyway (AC will come on more often otherwise, even without my rack).

[–] [email protected] 3 points 10 months ago

Thinkcenter tiny, 4 external HDDs, a DAC, a raspi3b+, was like 25W I think.

[–] [email protected] 3 points 10 months ago* (last edited 10 months ago)

I have a small setup for some self hosted apps and media.

  • Beelink Mini S.
  • 2 external 5TB drives.
  • A USB fan used as an exhaust because the SSD inside gets a bit warm.

I think total power is about 30W.

[–] [email protected] 2 points 10 months ago

I use a Ryzen 5900x, RTX 3080, 2x 10Gbit sfp+ NIC, 128GB ECC RAM, and only 2x 20TB drives at the moment.

For my gateway, I have an Intel N6005 box, I have a managed 2.5/10Gbit switch, and I have a wifi AP.

I have a ton of Proxmox VMs and containers.

All that hovers between 140W to 180W

[–] [email protected] 2 points 10 months ago* (last edited 10 months ago)

I run a NUC11 so about 10W. 15-20€ per annum assuming a single tariff at 0.17€ per kwh. It can use up to 30W but only during heavy load which may be like 8 hours a week. But electricity is also cheaper during off peak hours so it averages to about that (we have 5 tariffs).

Load is NAS, media server, homeassistant and a usb zigbee router, *arr stack.

Power usage was my main concern and wanted something eco friendly.

[–] [email protected] 2 points 10 months ago
[–] [email protected] 2 points 10 months ago

From the wall I'm pulling 120w

Ryzen 5700G

128GB ram

2tb + 4tb NVMe drive

2 x 20tb HDDs

Unifi Enterprise 24 PoE

Mikrotik RB5009

2 access points

3 cameras

Fiber runs cooler than copper all of my SFP+ are fiber.

[–] [email protected] 2 points 10 months ago* (last edited 10 months ago)

About 30 watts for a old Lenovo Thinkcentre with a i5-6500T and 8 GB RAM in combination with a DAS and 2x2TB HDD's. I'm currently waiting for parts for my new server I'm building, a small N100 Mini-ITX board with 4x4TB HDD's that hopefully has a similar power consumption.

[–] [email protected] 1 points 10 months ago

Systems themselves are all around 5-20W, although the ones with mechanical HDDs obviously add their own idle usage.

[–] [email protected] 1 points 10 months ago* (last edited 10 months ago)

About 120W total for:

  • 2 Proxmox hosts with 4 spinning disks between them
  • Opnsense firewall
  • 24 port GbE switch
  • Fiber ONT
  • Unifi AP
load more comments
view more: next ›