NVIDIA's NeRF AI instantly turns 2D photos into 3D objects

[UltraMega]

Quote

A new technology called Neural Radiance Field or NeRF involves training AI algorithms to enable the creation of 3D objects from two-dimensional photos. NeRF has the capability to fill in the blanks, so to speak, by interpolating what the 2D photos didn't capture. It's a neat trick that could lead to advances in various fields, such as video games and autonomous driving. Now, NVIDIA has developed a new NeRF technique — the fastest one to date, the company claims — that only needs seconds to train and to generate a 3D scene. 

 

It only takes seconds to train the model, called Instant NeRF, using dozens of still photos and the camera angles they were taken from. After that, it's capable of generating a 3D scene within just "tens of milliseconds." Like other NeRF techniques, it requires images taken from multiple positions. And for photos with multiple subjects, pictures taken without too much motion is preferred, otherwise the result would be blurry. 

 

Check out Instant NeRF in action below:

 

NVIDIA's NeRF AI instantly turns 2D photos into 3D objects

WWW.MSN.COM

---

A new technology called Neural Radiance Field or NeRF involves training AI algorithms to enable the creation of 3D objects from two-dimensional photos. NeRF has the capability to fill in the blanks, so to...

 

Looks super cool. Could be really neat for photos, but I'd imagine this could also be used to generate 3D assets for games. 

[Andrew]

This is incredibly powerful and would render laser scanning (at least for video games) obsolete if it works as advertised.

[UltraMega]

59 minutes ago, Andrew said:

This is incredibly powerful and would render laser scanning (at least for video games) obsolete if it works as advertised.

Yea for sure. If it works as well as they claim it could make Quixel's photogramatry process look outdated pretty suddenly. 

[mouacyk]

Have a feeling the tricky bit is actually turning these into usable 3D meshes that can be optimized for real-time use. Suppose, there is AI coming for that as well.

[J7SC_Orion]

could be nifty, if it works as advertised...