toms hardware GPUs can now use PCIe-attached memory or SSDs to boost VRAM capacity

[ENTERPRISE]

Quote

Modern GPUs for AI and HPC applications come with a finite amount of high-bandwidth memory (HBM) built into the device, limiting their performance in AI and other workloads. However, new tech will allow companies to expand GPU memory capacity by slotting in more memory with devices connected to the PCIe bus instead of being limited to the memory built into the GPU — it even allows using SSDs for memory capacity expansion, too. Panmnesia, a company backed by South Korea's renowned KAIST research institute, has developed a low-latency CXL IP that could be used to expand GPU memory using CXL memory expanders.

Source 

 

Definitely an advantage. Granted the access to any other system memory will be slower than onboard GPU memory, but depending on the application, it may not be an issue.

[UltraMega]

Hugely useful for AI applications, but seems unlikely to ever become a factor for gaming GPUs. Though maybe with GPU life cycles getting longer and longer, it could happen for gaming GPUs someday. 

[bonami2]

The sad thing is my Vega Frontier contain a HBCC High Bandwith Cache Controller that allow it to use onboard ram. I tested it doing crazy vr and 4k test and reached 28gb vram usage without issue!

[Sir Beregond]

On 03/07/2024 at 12:50, ENTERPRISE said:

Source 

 

Definitely an advantage. Granted the access to any other system memory will be slower than onboard GPU memory, but depending on the application, it may not be an issue.

Probably not useful for gaming. You'll take a hit accessing slower VRAM. 

 

People like to call the GTX 970 the "3.5GB" card, but it did in fact have 4GB. It's just that the last 0.5GB was super slow compared to the rest.

[ENTERPRISE]

On 11/07/2024 at 18:29, Sir Beregond said:

Probably not useful for gaming. You'll take a hit accessing slower VRAM. 

 

People like to call the GTX 970 the "3.5GB" card, but it did in fact have 4GB. It's just that the last 0.5GB was super slow compared to the rest.

 

Yeah, gaming would be a bad idea using this technology. Ha, I almost forgot about the GTX 970 fiasco! Those were the good ole days.

[Kaz]

On 11/07/2024 at 11:29, Sir Beregond said:

Probably not useful for gaming. You'll take a hit accessing slower VRAM. 

 

People like to call the GTX 970 the "3.5GB" card, but it did in fact have 4GB. It's just that the last 0.5GB was super slow compared to the rest.

It was worse than that.  When using the last .5 GB, it was unable to access the 3.5GB

[schuck6566]

On 11/07/2024 at 12:29, Sir Beregond said:

Probably not useful for gaming. You'll take a hit accessing slower VRAM. 

 

People like to call the GTX 970 the "3.5GB" card, but it did in fact have 4GB. It's just that the last 0.5GB was super slow compared to the rest.

 

17 hours ago, ENTERPRISE said:

 

Yeah, gaming would be a bad idea using this technology. Ha, I almost forgot about the GTX 970 fiasco! Those were the good ole days.

 

7 hours ago, Kaz said:

It was worse than that.  When using the last .5 GB, it was unable to access the 3.5GB

Don't everyone be ganging up on my poor MSI GTX 970 that STILL plays Witcher3 .....