CVPR 2023 – Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatars

In this episode we discuss Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatars
by Jingxiang Sun, Xuan Wang, Lizhen Wang, Xiaoyu Li, Yong Zhang, Hongwen Zhang, Yebin Liu. The paper proposes a novel 3D GAN framework for unsupervised learning of generative, high-quality, and 3D-consistent facial avatars from unstructured 2D images. The proposed framework combines both fine-grained expression control of mesh-guided explicit deformation and the flexibility of implicit volumetric representation. The proposed representation, called Generative Texture-Rasterized Tri-planes, achieves both deformation accuracy and topological flexibility and demonstrates state-of-the-art 3D-aware synthesis quality and animation ability through extensive experiments.