Modder creates method to run AI on cheap AMD APUs

[UltraMega]

Quote

The 4600G is currently selling at price of $95. It includes a 6-core CPU and 7-core GPU. 5600G is also inexpensive — around $130 with better CPU but the same GPU as 4600G.
 

It can be turned into a 16GB VRAM GPU under Linux and works similar to AMD discrete GPU such as 5700XT, 6700XT, …. It thus supports AMD software stack: ROCm. Thus it supports Pytorch, Tensorflow. You can run most of the AI applications.

16GB VRAM is also a big deal, as it beats most of discrete GPU. Even those GPU has better computing power, they will get out of memory errors if application requires 12 or more GB of VRAM. Although the speed is an issue, it’s better than out of memory errors.

 

Democratize AI: turn a $95 chip into a 16GB VRAM GPU! Beats most of the discrete GPUs! | by Ttiotech | Aug, 2023 | Medium

 

TLDR: AI needs a decent amount of Vram to work. GPUs with enough Vram are expensive. This is a way around that problem. 

 

[ENTERPRISE]

Wow, talk about a budget workaround!

[GanjaSMK]

That's pretty awesome. Here's hoping somehow they're able to increase inputs and decrease output times as the technology improves ~

[UltraMega]

In other news: 

Nvidia generates up to 1,000% profit for each H100 GPU sold

WWW.TECHSPOT.COM

---

For every H100 GPU accelerator sold, Nvidia appears to be making a remarkable profit, with reported margins reaching 1,000 percent of production costs. Tae Kim, a senior...

 

[ozlay]

I was wondering why I can set my 5700g to 32gigs.