Jump to content

Welcome to ExtremeHW

Welcome to ExtremeHW, register to take part in our community, don't worry this is a simple FREE process that requires minimal information for you to signup.

 

Registered users can: 

  • Start new topics and reply to others.
  • Show off your PC using our Rig Creator feature.
  • Subscribe to topics and forums to get updates.
  • Get your own profile page to customize.
  • Send personal messages to other members.
  • Take advantage of site exclusive features.
  • Upgrade to Premium to unlock additional sites features.
IGNORED

AMD: MI300X Dedicated AI accelerator revealed


UltraMega

Recommended Posts

Quote

AMD introduced the new Instinct MI300X chip as a dedicated generative AI accelerator. It leverages the same basic chiplet design as the previously announced Instinct MI300A (which AMD is now sampling), but the MI300X substitutes the 24 Zen 4 CPU cores in the MI300A with additional CDNA3 GPU cores and High Bandwidth Memory (HBM).

 

Indeed, this new chip – with a total of 153 billion transistors – boasts 192 GB of HBM and offers 5.2 TB/second of memory bandwidth. These numbers represent a 2.4x increase in memory capacity and a 1.6x enhancement in throughput compared to Nvidia's current H100 accelerator. Although these figures may be overwhelming for most applications, large language models (LLMs) run most efficiently in memory, indicating this should translate to solid real-world performance when the chip begins sampling in the third quarter of this year.

WWW.TECHSPOT.COM

Up until now, the big winner in the generative AI GPU game has been Nvidia, thanks to a combination of...

 

 

 

Honestly I did not expect to see such a strong showing in dedicated AI hardware from AMD this soon. AMD proving they're not getting complacent, they want to compete. 

Owned

 Share

CPU: 5800x
MOTHERBOARD: ASUS TUF Gaming B550-Plus
RAM: XMP 3600mhz CL16
GPU: 7900XT
SOUNDCARD: Sound Blaster Z 5.1 home theater
MONITOR: 4K 65 inch TV
Full Rig Info
Link to comment
Share on other sites

On 15/06/2023 at 05:13, UltraMega said:
WWW.TECHSPOT.COM

Up until now, the big winner in the generative AI GPU game has been Nvidia, thanks to a combination of...

 

 

 

Honestly I did not expect to see such a strong showing in dedicated AI hardware from AMD this soon. AMD proving they're not getting complacent, they want to compete. 

They have definitely gotten complacent with certain markets, but I think it's generally the markets where there's currently no competition like HEDT. Have we really gotten any new Threadrippers since Zen 2 for the mass market?

 

Gaming graphics is largely a marketing and pricing problem. I think they've otherwise been competitive performance wise, but definitely playing catchup feature wise and they aren't building good marketing or launch prices around that. That's why RDNA3 kinda flopped initially. I think recent market corrections on the 7900 XT have helped that a lot. Its a great card. It's not a $900 card as much as the 4080 isn't a $1200 card.

 

Ryzen remains very competitive with Intel for the general market. At this stage I'd only go Intel again for the overclocking on a test bench as overclocking kinda sucks on Ryzen. But again that's OC enthusiast versus general gaming or otherwise market. They are doing well there and I certainly like the lower power of a Zen 3/Zen 4 part vs 12th/13th gen Intel.

Edited by Sir Beregond

Showcase

 Share

CPU: AMD Ryzen 9 5900X
GPU: Nvidia RTX 3080 Ti Founders Edition
RAM: G.Skill Trident Z Neo 32GB DDR4-3600 (@ 3733 14-8-14-14-21-35 1T GDM)
MOTHERBOARD: ASUS Crosshair VIII Dark Hero
SSD/NVME: x2 Samsung 970 Evo Plus 2TB
SSD/NVME 2: Crucial MX500 1TB
PSU: Corsair RM1000x
MONITOR: LG 48" C1 OLED
Full Rig Info

Owned

 Share

CPU: Intel Core i7-4790K, Core i9-10900K, Core i3-13100, Core i9-13900KS
GPU: various
RAM: Corsair 32GB DDR3-2400 | Oloy Blade 16GB DDR4-3600 | Crucial 16GB DDR5-5600
MOTHERBOARD: ASUS Z97 Deluxe | EVGA Z490 Dark | EVGA Z790 Dark Kingpin
SSD/NVME: Samsung 870 Evo 1TB | Inland 1TB Gen 4
PSU: BeQuiet Straight Power 12 1500W
CASE: Cooler Master MasterFrame 700 - bench mode
OPERATING SYSTEM: Windows 10 LTSC
Full Rig Info

Owned

 Share

CPU: M1 Pro
RAM: 32GB
SSD/NVME: 1TB
OPERATING SYSTEM: MacOS Sonoma
CASE: Space Grey
Full Rig Info
Link to comment
Share on other sites

Folding@Home Staff - Team Lead
1.1k 1,019

Ok so if this crappy MI25 had an MSRP of like $15,000, are these going to be going for $100K or what? How much is the Hopper?

 

BTW I picked this MI25 up a couple months ago for like $65 😄

 

 

Edited by damric

Owned

 Share

CPU: Ryzen 9 5950x
MOTHERBOARD: B550 PG Velocita
RAM: 4x8GB Ballistix
GPU: RX 6900 XT
PSU: LEADEX V Platinum 1KW
CASE: QUBE 500
SSD/NVME: T-FORCE CARDEA A440 PRO
Full Rig Info

Cheap

Owned

 Share

CPU: Ryzen 5 5500
MOTHERBOARD: X470 TAICHI
RAM: Crucial Ballistix MAX 2x8GB
PSU: EVGA SUPERNOVA P5
SSD/NVME: Silicon Power A60 256GB
GPU: Quadro M4000
GPU 2: Quadro M4000
GPU 3: Quadro M2000
Full Rig Info
Link to comment
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now


×
×
  • Create New...

Important Information

This Website may place and access certain Cookies on your computer. ExtremeHW uses Cookies to improve your experience of using the Website and to improve our range of products and services. ExtremeHW has carefully chosen these Cookies and has taken steps to ensure that your privacy is protected and respected at all times. All Cookies used by this Website are used in accordance with current UK and EU Cookie Law. For more information please see our Privacy Policy