newscientist AI can turn 2D images into explorable 3D world

[UltraMega]

Quote

By feeding the neural network a selection of images of a scene and a rough 3D model of the scene created automatically using off-the-shelf software called COLMAP, it is able to accurately visualise what the scene would look like from any viewpoint.

 

The neural network, developed by Darius Rückert and colleagues at the University of Erlangen-Nuremberg in Germany, is different to previous systems because it is able to extract physical properties from still images.

 

“We can change the camera pose and therefore get a new view of the object,” he says.

 

The system could technically create an explorable 3D world from just two images, but it wouldn’t be very accurate. “The more images you have, the better the quality,” says Rückert. “The model cannot create stuff it hasn’t seen.”

Artificial intelligence: 2D images transformed into explorable 3D worlds | New Scientist

WWW.NEWSCIENTIST.COM

---

A neural network can turn a selection of photographs of a scene into a 3D world that can then be viewed from...

 

 

Imagine if they could do this with msfs2020...

[mouacyk]

Wow, what a great base line to start with for artists.

Edited October 27, 2021 by mouacyk