ODGS

<div align="center">

</div> <p align="center"> <h1 align="center">ODGS: 3D Scene Reconstruction from Omnidirectional Images <br> with 3D Gaussian Splatting</h1> <p align="center"> <a href="https://esw0116.github.io/">Suyoung Lee</a>* &nbsp;·&nbsp; <a href="https://robot0321.github.io/">Jaeyoung Chung</a>* &nbsp;·&nbsp; Jaeyoo Huh &nbsp;·&nbsp; <a href="https://cv.snu.ac.kr/index.php/~kmlee/">Kyoung Mu Lee</a> </br> (* denotes equal contribution) </p> <h3 align="center">NeurIPS 2024</h3> </p> <!-- <div align="center"> [![ArXiv]()]() [](https://github.com/luciddreamer-cvlab/LucidDreamer) [](https://github.com/luciddreamer-cvlab/LucidDreamer/blob/master/LICENSE) </div> --> <p align="center"> <img src="assets/logo_cvlab.png" height=60> </p>

---

This is an official implementation of "ODGS: 3D Scene Reconstruction from Omnidirectional Images with 3D Gaussian Splatting."

<p align="center"> <img src="assets/method_coord.png" height=400> </p>

Update Log

24.12.08: First upload (CUDA rasterizer and training code)
24.12.26: Update project page and video hyperlink

Installation

git clone https://github.com/esw0116/ODGS.git --recursive
cd ODGS

# Set Environment
conda env create --file environment.yaml
conda activate ODGS
pip install submodules/simple-knn
pip install submodules/odgs-gaussian-rasterization

Dataset

We evaluate 6 datasets by adjusting their resolutions and performing Structure-from-Motion using OpenMVG.
For your convenience, we provide :star:links to the adjusted datasets:star: used in our paper.
Note: The authors of 360Roam dataset do not want to distribute thier datasets yet (8 Dec. 2024), so we will not provide here. If you need, please contact them.

For reference, we provide the links to the original datasets here.
OmniBlender & Ricoh360 / OmniPhotos / 360Roam / OmniScenes / 360VO

Training (Optimization)

ODGS requires optimization for each scene. Run the script below to start optimization:

python train.py -s <source(dataset)_path> -m <output_path> --eval

<section class="section" id="BibTeX"> <div class="container is-max-desktop content"> <h2 class="title">Citation</h2> <pre><code>@article{lee2024odgs, title={ODGS: 3D Scene Reconstruction from Omnidirectional Images with 3D Gaussian Splattings}, author={Lee, Suyoung and Chung, Jaeyoung and Huh, Jaeyoo and Lee, Kyoung Mu}, journal={Advances in Neural Information Processing Systems (NeurIPS)}, volume={37}, year={2024} }</code></pre> </div> </section>

Qualitative Comparisons

<p align="center"> <img src="assets/qual_v.png" width=800> </p>