GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splatting

By Yiwen Chen, Zilong Chen, Chi Zhang, Feng Wang, Xiaofeng Yang, Yikai Wang, Zhongang Cai, Lei Yang, Huaping Liu, Guosheng Lin. Computer Vision and Pattern Recognition, 2023

432 citations recorded by the source corpus.

3D editing plays a crucial role in many areas such as gaming and virtual reality. Traditional 3D editing methods, which rely on representations like meshes and point clouds, often fall short in realistically depicting complex scenes. On the other hand, methods based on implicit 3D representations, like Neural Radiance Field (NeRF), render complex scenes effectively but suffer from slow processing speeds and limited control over specific scene areas. In response to these challenges, our paper presents GaussianEditor, the first 3D editing algorithm based on Gaussian Splatting (GS), a novel 3D representation. GaussianEditor enhances precision and control in editing through our proposed Gaussian semantic tracing, which traces the editing target throughout the training process. Additionally, we propose Hierarchical Gaussian splatting (HGS) to achieve stabilized and fine results under stochastic generative guidance from 2D diffusion models. We also develop editing strategies for efficient object removal and integration, a challenging task for existing methods. Our comprehensive experiments demonstrate GaussianEditor's superior control, effective, and efficient performance, marking a significant advancement in 3D editing.

Subfields: Computational Mechanics, Computer Graphics and Computer-Aided Design, Computer Vision and Pattern Recognition

View Paper: https://www.semanticscholar.org/paper/bbc6531afdfe41fe8664002a80d9d73a07a080d2

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computational Mechanics

1. Jiaxiang Tang
2. Gang Zeng
3. Zhaoxi Chen
4. Ziwei Liu

In Computer Graphics and Computer-Aided Design

1. Jiaxiang Tang
2. Gang Zeng
3. Zhaoxi Chen
4. Tengfei Wang
5. Ziwei Liu
6. Xiaokang Chen

In Computer Vision and Pattern Recognition

1. Gang Zeng
2. Xiaokang Chen
3. Tengfei Wang
4. Zhaoxi Chen
5. Jiaxiang Tang
6. Ziwei Liu
7. Chen Change Loy
8. Luc Van Gool

Citations in the corpus

• LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creation (2024, methodology): “We specifically discuss recent methods in generation tasks using Gaussian splatting [4,7,23,38,56].”