this post was submitted on 06 Sep 2023
26 points (93.3% liked)

LocalLLaMA

2825 readers
20 users here now

Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.

Get support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.

As ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.

founded 2 years ago
MODERATORS
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
26
How usable are AMD GPUs? (lemmy.dbzer0.com)
submitted 2 years ago* (last edited 2 years ago) by [email protected] to c/[email protected]
47 comments fedilink hide all child comments
 

Heyho, I'm currently on a RTX3070 but want to upgrade to a RX 7900 XT

I see that AMD installers are there, but is it all smooth sailing? How well do AMD cards compare to NVidia in terms of performance?

I'd mainly use oobabooga but would also love to try some other backends.

Anyone here with one of the newer AMD cards that could talk about their experience?

EDIT: To clear things up a little bit. I am on Linux, and i'd say i am quite experienced with it. I know how to handle a card swap and i know where to get my drivers from. I know of the gaming performance difference between NVidia and AMD. Those are the main reasons i want to switch to AMD. Now i just want to hear from someone who ALSO has Linux + AMD what their experience with Oobabooga and Automatic1111 are when using ROCm for example.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 1 points 2 years ago* (last edited 2 years ago) (1 children)

made this video a while ago. shoud contain all relevant infos

[–] [email protected] 1 points 2 years ago (1 children)

Thanks

I was hoping to see a console output that shows me the iterations per second in dependence of the specific sampler. But I guess that suffices

Thanks again!

[–] [email protected] 1 points 2 years ago (1 children)

can send you a video with my terminal once I get home

[–] [email protected] 1 points 2 years ago (1 children)

That'd be awesome. No hurries though

[–] [email protected] 2 points 2 years ago (2 children)

I'm getting around 4.3 iterations per second

[–] [email protected] 1 points 2 years ago

Perfect, thanks!