Gaussian Opacity Fields

Improved Mip-Splatting with better geometry.

Web: https://niujinshuchong.github.io/gaussian-opacity-fields/
Paper: Gaussian Opacity Fields: Efficient and Compact Surface Reconstruction in Unbounded Scenes
Authors: Zehao Yu, Torsten Sattler, Andreas Geiger

Mip-NeRF 360

Mip-NeRF 360 is a collection of four indoor and five outdoor object-centric scenes. The camera trajectory is an orbit around the object with fixed elevation and radius. The test set takes each n-th frame of the trajectory as test views.

Scene PSNR SSIM LPIPS (VGG) Time GPU mem.
garden 27.55 0.874 0.115 1h 13m 32s 34.59 GB
bicycle 25.52 0.792 0.197 1h 11m 12s 37.49 GB
flowers 21.71 0.639 0.308 53m 26s 33.63 GB
treehill 22.44 0.643 0.320 57m 48s 33.73 GB
stump 26.99 0.798 0.223 52m 14s 33.82 GB
kitchen 31.23 0.925 0.158 1h 12m 30s 22.96 GB
bonsai 31.94 0.940 0.247 59m 18s 23.38 GB
counter 28.83 0.907 0.258 1h 5m 60s 12.64 GB
room 30.59 0.913 0.282 1h 9m 1s 23.70 GB
Average 27.42 0.826 0.234 1h 3m 54s 28.44 GB

Blender

Blender (nerf-synthetic) is a synthetic dataset used to benchmark NeRF methods. It consists of 8 scenes of an object placed on a white background. Cameras are placed on a semi-sphere around the object. Scenes are licensed under various CC licenses.

Scene PSNR SSIM LPIPS (VGG) Time GPU mem.
lego 35.56 0.982 0.021 19m 4s 2.88 GB
drums 26.17 0.955 0.045 17m 50s 2.84 GB
ficus 35.19 0.988 0.013 11m 10s 2.71 GB
hotdog 37.46 0.985 0.028 17m 52s 2.61 GB
materials 30.20 0.961 0.043 14m 48s 2.72 GB
mic 36.06 0.992 0.008 21m 56s 2.99 GB
ship 30.68 0.901 0.131 29m 60s 5.64 GB
chair 36.28 0.988 0.017 14m 46s 2.79 GB
Average 33.45 0.969 0.038 18m 26s 3.15 GB

Tanks and Temples

Tanks and Temples is a benchmark for image-based 3D reconstruction. The benchmark sequences were acquired outside the lab, in realistic conditions. Ground-truth data was captured using an industrial laser scanner. The benchmark includes both outdoor scenes and indoor environments. The dataset is split into three subsets: training, intermediate, and advanced.

Scene PSNR SSIM LPIPS Time GPU mem.
auditorium 23.20 0.871 0.194 35m 17s 8.44 GB
ballroom 22.84 0.818 0.107 1h 0m 31s 38.17 GB
courtroom 21.15 0.781 0.168 47m 1s 31.55 GB
museum 19.92 0.761 0.152 50m 33s 34.90 GB
palace 16.46 0.683 0.443 35m 6s 10.30 GB
temple 20.29 0.794 0.234 34m 55s 7.02 GB
family 22.31 0.875 0.084 41m 32s 35.16 GB
francis 24.76 0.901 0.158 35m 52s 12.30 GB
horse 23.73 0.881 0.092 38m 29s 24.41 GB
lighthouse 21.80 0.833 0.181 40m 8s 7.85 GB
m60 28.04 0.906 0.104 40m 9s 26.18 GB
panther 28.47 0.910 0.102 40m 13s 30.99 GB
playground 23.89 0.869 0.142 45m 37s 37.62 GB
train 19.69 0.796 0.164 37m 11s 19.04 GB
barn 25.72 0.866 0.140 37m 4s 15.67 GB
caterpillar 21.78 0.791 0.187 36m 21s 23.78 GB
church 19.65 0.775 0.208 48m 2s 36.45 GB
courthouse 19.60 0.726 0.346 35m 12s 12.82 GB
ignatius 20.34 0.769 0.162 43m 50s 34.97 GB
meetingroom 24.31 0.862 0.140 40m 29s 23.30 GB
truck 22.33 0.860 0.099 44m 56s 34.46 GB
Average 22.39 0.825 0.172 41m 21s 24.07 GB