Lightweight Gradient-Aware Upscaling of 3D Gaussian Splatting Images

Simon Niedermayr   Christoph Neuhauser   Rüdiger Westermann
Technical University of Munich

Webpage | arXiv

Abstract

We introduce an image upscaling technique tailored for 3D Gaussian Splatting (3DGS) on lightweight GPUs. Compared to 3DGS, it achieves significantly higher rendering speeds and reduces artifacts commonly observed in 3DGS reconstructions. Our technique upscales low-resolution 3DGS renderings with a marginal increase in cost by directly leveraging the analytical image gradients of Gaussians for gradient-based bicubic spline interpolation. The technique is agnostic to the specific 3DGS implementation, achieving novel view synthesis at rates 3x-4x higher than the baseline implementation. Through extensive experiments on multiple datasets, we showcase the performance improvements and high reconstruction fidelity attainable with gradient-aware upscaling of 3DGS images. We further demonstrate the integration of gradient-aware upscaling into the gradient-based optimization of a 3DGS model and analyze its effects on reconstruction quality and performance.

Citation

If you find our work useful, please cite:

@misc{niedermayr2025upscaling3dgs,
    title={Lightweight Gradient-Aware Upscaling of 3D Gaussian Splatting Images}, 
    author={Simon Niedermayr and Christoph Neuhauser Rüdiger Westermann},
    year={2025},
    booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
    year = {2025},
}

Code

For viewing 3DGS reconstructions with our upscaling method, please refer to our web-based viewer.

Training code is coming soon.