Gaussian Splatting VR

Описание: ✨ 𝗧𝗲𝗰𝗵𝗻𝗼𝗹𝗼𝗴𝗶𝗰𝗮𝗹 𝗲𝘃𝗼𝗹𝘂𝘁𝗶𝗼𝗻: 𝗖𝗹𝗮𝗿𝘁𝗲́ 𝗮𝗰𝗵𝗶𝗲𝘃𝗲𝘀 𝗮 𝘄𝗼𝗿𝗹𝗱 𝗳𝗶𝗿𝘀𝘁 𝗯𝘆 𝗶𝗻𝘁𝗲𝗴𝗿𝗮𝘁𝗶𝗻𝗴 𝟯𝗗 𝗚𝗮𝘂𝘀𝘀𝗶𝗮𝗻 𝗦𝗽𝗹𝗮𝘁𝘁𝗶𝗻𝗴 𝘁𝗲𝗰𝗵𝗻𝗼𝗹𝗼𝗴𝘆 𝗶𝗻𝘁𝗼 𝗮 𝗩𝗶𝗿𝘁𝘂𝗮𝗹 𝗥𝗲𝗮𝗹𝗶𝘁𝘆 𝘀𝗶𝗺𝘂𝗹𝗮𝘁𝗶𝗼𝗻.

Presented last month at the SIGGRAPH conference, the 3D Gaussian Splatting method recently developed by Inria enables visual synthesis of 3D scenes generated from photos in real time and with exceptional quality.

🚀 Our VR/AR engineer and AI expert, Pierre-Olivier Pigny, has exploited the "gaussian splatting rasterizer" source code made available by the author to develop an immersive virtual reality experience in Unity. Thanks to this integration, it is now possible to immerse yourself in extremely realistic environments synthesised from a limited number of photos (generally 100 to 200 photos).

This method offers several advantages:
✅ A rendering algorithm that reduces calculations in empty areas as opposed to nerf
✅ Better representation of the scene
✅ Fast rendering algorithm for high-quality images in real time

Previously, reconciling visual quality and speed was a challenge. Existing methods were resource-intensive and produced inferior results.

If you have a powerful PC (minimum GPU RTX3070, 4070 recommended) and a VR headset, to see for yourself and access the Windows executable, click here : https://github.com/clarte53/GaussianS...

✨ The source code for our demonstration is now available on GitHub

Inria, Université Côte d’Azur, Bernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George Drettakis, Jonathan Stephens

#GaussianSplatting #VirtualReality #3D #Unity #NewTechnologies #VR #NERF