toms hardware GPUs can now use PCIe-attached memory or SSDs to boost VRAM capacity

[ENTERPRISE]

  Quote

Modern GPUs for AI and HPC applications come with a finite amount of high-bandwidth memory (HBM) built into the device, limiting their performance in AI and other workloads. However, new tech will allow companies to expand GPU memory capacity by slotting in more memory with devices connected to the PCIe bus instead of being limited to the memory built into the GPU — it even allows using SSDs for memory capacity expansion, too. Panmnesia, a company backed by South Korea's renowned KAIST research institute, has developed a low-latency CXL IP that could be used to expand GPU memory using CXL memory expanders.

Expand  

Source 

 

Definitely an advantage. Granted the access to any other system memory will be slower than onboard GPU memory, but depending on the application, it may not be an issue.

[UltraMega]

Hugely useful for AI applications, but seems unlikely to ever become a factor for gaming GPUs. Though maybe with GPU life cycles getting longer and longer, it could happen for gaming GPUs someday. 

[bonami2]

The sad thing is my Vega Frontier contain a HBCC High Bandwith Cache Controller that allow it to use onboard ram. I tested it doing crazy vr and 4k test and reached 28gb vram usage without issue!

[Sir Beregond]

  On 03/07/2024 at 18:50, ENTERPRISE said:

Source 

 

Definitely an advantage. Granted the access to any other system memory will be slower than onboard GPU memory, but depending on the application, it may not be an issue.

Expand  

Probably not useful for gaming. You'll take a hit accessing slower VRAM. 

 

People like to call the GTX 970 the "3.5GB" card, but it did in fact have 4GB. It's just that the last 0.5GB was super slow compared to the rest.

[ENTERPRISE]

  On 11/07/2024 at 17:29, Sir Beregond said:

Probably not useful for gaming. You'll take a hit accessing slower VRAM. 

 

People like to call the GTX 970 the "3.5GB" card, but it did in fact have 4GB. It's just that the last 0.5GB was super slow compared to the rest.

Expand  

 

Yeah, gaming would be a bad idea using this technology. Ha, I almost forgot about the GTX 970 fiasco! Those were the good ole days.

[Kaz]

  On 11/07/2024 at 17:29, Sir Beregond said:

Probably not useful for gaming. You'll take a hit accessing slower VRAM. 

 

People like to call the GTX 970 the "3.5GB" card, but it did in fact have 4GB. It's just that the last 0.5GB was super slow compared to the rest.

Expand  

It was worse than that.  When using the last .5 GB, it was unable to access the 3.5GB

[schuck6566]

  On 11/07/2024 at 17:29, Sir Beregond said:

Probably not useful for gaming. You'll take a hit accessing slower VRAM. 

 

People like to call the GTX 970 the "3.5GB" card, but it did in fact have 4GB. It's just that the last 0.5GB was super slow compared to the rest.

Expand  

 

  On 12/07/2024 at 20:51, ENTERPRISE said:

 

Yeah, gaming would be a bad idea using this technology. Ha, I almost forgot about the GTX 970 fiasco! Those were the good ole days.

Expand  

 

  On 13/07/2024 at 07:05, Kaz said:

It was worse than that.  When using the last .5 GB, it was unable to access the 3.5GB

Expand  

Don't everyone be ganging up on my poor MSI GTX 970 that STILL plays Witcher3 .....