3D Gaussian Splatting: Optimization Explained & Viewer Demo

Описание: I've looked into Gaussian splatting computation graph presented in the paper "gsplat: An Open-Source Library for Gaussian Splatting". Towards the end of the video, I used camenduru's "gaussian splatting colab" to train Gaussian splatting. I've also used antimatter15's splat viewer to view the output of Gaussian splatting.
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
🔗 notes+code: https://mashaan14.github.io/YouTube-c...
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
website https://mashaan14.github.io/mashaan/
github https://github.com/mashaan14
X   / mashaan_14  
linkedin   / mashaan  
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
sponsor this channel on GitHub Sponsors:
https://github.com/sponsors/mashaan14
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
Acknowledgment:
Thanks to Dr. Adel F. Ahmed for introducing me to this problem. Adel is a great graphics researcher, I enjoyed working with him on multiple projects including my masters thesis.
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
Chapters:
00:00 start
01:27 Gaussians in 1D, 2D, and 3D
02:38 input to Gaussian splatting
05:02 the loss function
05:54 optimizing the color and opacity
07:53 optimizing the mean
09:15 why we don't optimize the covariance matrix?
13:05 optimizing scaling and quaternions
17:59 gsplat code
20:18 training Gaussian splatting
21:40 viewing the output of Gaussian splatting
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
References:
Kerbl, B., Kopanas, G., Leimkühler, T., & Drettakis, G. (2023). 3d gaussian splatting for real-time radiance field rendering. ACM Trans. Graph., 42(4), 139-1.
Ye, V., Li, R., Kerr, J., Turkulainen, M., Yi, B., Pan, Z., ... & Kanazawa, A. (2025). gsplat: An open-source library for Gaussian splatting. Journal of Machine Learning Research, 26(34), 1-17.
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
#GaussianSplatting #Gaussian #Splatting #NeRF #RadianceField #rendering #graphics #NeuralRadianceFields #pytorch #computervision #DeepLearningTutorial #MachineLearningProject #AIResearch #CodingTutorial