LocalLLaMA

2865 readers

60 users here now

Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.

Get support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.

As ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.

founded 2 years ago

MODERATORS

[email protected]

Advice Wanted - Self Hosting Industrial GPUs (kbin.social)

submitted 2 years ago by [email protected] to c/[email protected]

7 comments fedilink hide all child comments

I just bought a "new" homelab server and am considering adding in some used/refurbished NVIDIA Tesla K80s. They have 24 GB of VRAM and tons of compute power for very cheap if you get them used.

The issue is that these cards run super hot and require extra cooling set ups. I was able to find this fan adapter kit on eBay. But I still worry that if I pop one or two of these bad boys in my server that the fan won't be enough to overcome the raw heat put off by the K80.

Have any of you run this kind of card in a home lab setting? What kind of temps do you get when running models? Would a fan like this actually be enough to cool the thing? I appreciate any insight you guys might have!

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 3 points 2 years ago (2 children)

No matter what grade of heat dissipation equipment the GPU device itself uses, the temperature of the room is low enough is the key.

So an additional expense for you is the power to cool the air, put your servers in a room that is small enough and sealed enough so that the air conditioner will consume less power.

If you use an additional ordinary fan to blow air against the servers, you can significantly reduce the temperature.

[–] [email protected] 3 points 2 years ago

Thanks for the input. I live in a cold state and all the machines are in the basement, so even in summer it's pretty cool in there. This gives me hope!

[–] [email protected] 1 points 2 years ago

just wondering but isnt a airco kinda overkill would a fan to the outside not be enough? I mean yea if you have 20c (68f) air vs 30c (86f) the 20c air is going to cool better but if that means 800w of power consumption to cool a 400w server that means a big powerbill here in the eu.