13
AMD RDNA 3 professional GPUs with 48GB can beat Nvidia 24GB cards in AI — putting the 'Large' in LLM
(www.tomshardware.com)
All things related to technology hardware, with a focus on computing hardware.
Follow the Lemmy.world Rules - https://mastodon.world/about
Be kind. No bullying, harassment, racism, sexism etc. against other users.
No Spam, illegal content, or NSFW content.
Please stay on topic, adjacent topics (e.g. software) are fine if they are strongly relevant to technology hardware. Another example would be business news for hardware-focused companies.
Please try and post original sources when possible (as opposed to summaries).
If posting an archived version of the article, please include a URL link to the original article in the body of the post.
Some other hardware communities across Lemmy:
Icon by "icon lauk" under CC BY 3.0
Why is AMD comparing their 48Gb professional cards to Nvidia's 24Gb gaming cards? They do know Nvidia makes 48Gb cards, don't they? (the A5880 & A6000)
They specifically picked models which take up more than 24Gb VRAM, so the Nvidia cards would have to use system RAM. They did the same thing with their Strix Halo benchmark.
This is why no one takes AMD seriously in AI.
I assume comparison was done based on cost, not RAM amount parity, which makes sense because its price/performance you’re most interested in usually.