techspot DirectX to support AI rendering features

[UltraMega]

  Quote

Microsoft recently announced what could be the next major development in the history of DirectX. The High-Level Shader Language (HLSL) team is currently working with major GPU and SoC manufacturers to bring support for neural rendering technology in the company's APIs for 3D graphics, which Microsoft described as a significant evolution in what's possible with real-time graphics.

 

Redmond defines neural rendering as a suite of techniques capable of leveraging artificial intelligence, machine learning algorithms, and models to evolve traditional graphics pipelines. Cooperative vectors are the core element of these new neural rendering methods, and they should soon become part of the DirectX API suite for cross-platform game development.

 

Cooperative vectors are useful for accelerating AI workloads for real-time rendering, which in turn will improve the performance of neural rendering techniques. Cooperative vectors optimize the matrix-vector operations that are usually required in large quantities for AI training, fine-tuning, and inferencing, Microsoft explained.

Expand  

https://www.techspot.com/news/106318-microsoft-support-next-gen-neural-rendering-technology-directx.html

 

 

Seems like the potential to use NPUs to speed up RT workloads is huge. Will be really interesting to see how this evolves. 

 

 

There's also a lot of "neural" tech demo stuff in this DF video from CES 2025:

 

 

Edited January 13 by UltraMega

[Slaughtahouse]

  On 13/01/2025 at 18:45, UltraMega said:

https://www.techspot.com/news/106318-microsoft-support-next-gen-neural-rendering-technology-directx.html

 

 

Seems like the potential to use NPUs to speed up RT workloads is huge. Will be really interesting to see how this evolves. 

Expand  

Microsoft and commitments don't go well together. 

 

Potential is probably there but I remain extremely skeptical we'll see wide spread adoption of whatever they're trying to attempt. If they optimize the use of "NPUs" like tensor cores on Nvidia cards to improve performance when using DLSS or other neural rendering, sure I am all for it

[UltraMega]

  On 14/01/2025 at 14:45, Slaughtahouse said:

Microsoft and commitments don't go well together. 

 

Potential is probably there but I remain extremely skeptical we'll see wide spread adoption of whatever they're trying to attempt. If they optimize the use of "NPUs" like tensor cores on Nvidia cards to improve performance when using DLSS or other neural rendering, sure I am all for it

Expand  

DLSS already runs on the NPUs in an Nvidia card. Using other NPUs like the ones integrated into a modern CPU probably wouldn't work for DLSS since the NPU on a CPU would have a latency penalty and DLSS relies on very fast/near-instant processing.

 

I think this is more aimed at opening up NPUs to being used for more than just upscaling. It sounds like they want to establish an API that will give devs some openness and flexibility in how they use an NPU for games. 

 

Perhaps we could eventually see games that opt not to offer DLSS so that the NPU is available to do other things for the game.

[Slaughtahouse]

  On 14/01/2025 at 19:20, UltraMega said:

DLSS already runs on the NPUs in an Nvidia card. Using other NPUs like the ones integrated into a modern CPU probably wouldn't work for DLSS since the NPU on a CPU would have a latency penalty and DLSS relies on very fast/near-instant processing.

 

I think this is more aimed at opening up NPUs to being used for more than just upscaling. It sounds like they want to establish an API that will give devs some openness and flexibility in how they use an NPU for games. 

 

Perhaps we could eventually see games that opt not to offer DLSS so that the NPU is available to do other things for the game.

Expand  

 

A dev wont utilize a dedicated NPU anytime soon for games. GPUs already have the latest and greatest, and have enough market saturation to make it worth while. If PS6 or Xbox Series Y or w.e has a separate NPU, then sure, add another 2-3 years before we see some optimization. 

[UltraMega]

  On 14/01/2025 at 19:44, Slaughtahouse said:

 

A dev wont utilize a dedicated NPU anytime soon for games. GPUs already have the latest and greatest, and have enough market saturation to make it worth while. If PS6 or Xbox Series Y or w.e has a separate NPU, then sure, add another 2-3 years before we see some optimization. 

Expand  

 

Yea I agree that it will take a few years at least, but this is one of the first steps towards opening up NPU capabilities to allow for more general usage beyond just upscaling. I fully expect the next console gen to have NPUs that devs can use in a general way as they see fit.