AMD: MI300X Dedicated AI accelerator revealed

[UltraMega]

Quote

AMD introduced the new Instinct MI300X chip as a dedicated generative AI accelerator. It leverages the same basic chiplet design as the previously announced Instinct MI300A (which AMD is now sampling), but the MI300X substitutes the 24 Zen 4 CPU cores in the MI300A with additional CDNA3 GPU cores and High Bandwidth Memory (HBM).

 

Indeed, this new chip – with a total of 153 billion transistors – boasts 192 GB of HBM and offers 5.2 TB/second of memory bandwidth. These numbers represent a 2.4x increase in memory capacity and a 1.6x enhancement in throughput compared to Nvidia's current H100 accelerator. Although these figures may be overwhelming for most applications, large language models (LLMs) run most efficiently in memory, indicating this should translate to solid real-world performance when the chip begins sampling in the third quarter of this year.

AMD's take on AI: Instinct MI300X combines GPU cores with 192 GB of HBM3 memory

WWW.TECHSPOT.COM

---

Up until now, the big winner in the generative AI GPU game has been Nvidia, thanks to a combination of...

 

 

 

Honestly I did not expect to see such a strong showing in dedicated AI hardware from AMD this soon. AMD proving they're not getting complacent, they want to compete. 

[Sir Beregond]

On 15/06/2023 at 05:13, UltraMega said:

AMD's take on AI: Instinct MI300X combines GPU cores with 192 GB of HBM3 memory

WWW.TECHSPOT.COM

---

Up until now, the big winner in the generative AI GPU game has been Nvidia, thanks to a combination of...

 

 

 

Honestly I did not expect to see such a strong showing in dedicated AI hardware from AMD this soon. AMD proving they're not getting complacent, they want to compete. 

They have definitely gotten complacent with certain markets, but I think it's generally the markets where there's currently no competition like HEDT. Have we really gotten any new Threadrippers since Zen 2 for the mass market?

 

Gaming graphics is largely a marketing and pricing problem. I think they've otherwise been competitive performance wise, but definitely playing catchup feature wise and they aren't building good marketing or launch prices around that. That's why RDNA3 kinda flopped initially. I think recent market corrections on the 7900 XT have helped that a lot. Its a great card. It's not a $900 card as much as the 4080 isn't a $1200 card.

 

Ryzen remains very competitive with Intel for the general market. At this stage I'd only go Intel again for the overclocking on a test bench as overclocking kinda sucks on Ryzen. But again that's OC enthusiast versus general gaming or otherwise market. They are doing well there and I certainly like the lower power of a Zen 3/Zen 4 part vs 12th/13th gen Intel.

Edited June 16, 2023 by Sir Beregond

[damric]

Ok so if this crappy MI25 had an MSRP of like $15,000, are these going to be going for $100K or what? How much is the Hopper?

 

BTW I picked this MI25 up a couple months ago for like $65

 

 

Edited June 16, 2023 by damric