Skip to content

3D face reconstruction from single 2D human image using deep learning method

TL;DR

This thesis comprehensively investigates the contributions of all the loss functions to 3D face reconstruction through quantitative and qualitative analyses, and introduces a landmark mirroring strategy to improve the recovery of facial contours in occluded regions.

Abstract

Three-dimensional (3D) face reconstruction from a single two-dimensional (2D) image enables the creation of personalized 3D avatars that preserve facial identity for immersive applications in the metaverse. This thesis aims to develop a realistic 3D human avatar generation framework for the metaverse platform MANGOs (Metaverse of Academic Nexus for Global Opportunities). The framework employs the Faces Learned with an Articulated Model and Expressions (FLAME) model as the underlying parametric 3D representation of face to represent facial shape, pose, and expression. Inspired by Detailed Expression Capture and Animation (DECA), which reconstructs 3D facial geometry from a single 2D image without requiring explicit 3D ground-truth supervision, this thesis comprehensively investigates the contributions of all the loss functions to 3D face reconstruction through quantitative and qualitative analyses. This work is evaluated on the NOW benchmark using both non-metrical and metrical reconstruction protocols to assess the robustness and accuracy of the reconstruction framework. In addition, this thesis introduces a landmark mirroring strategy to improve the recovery of facial contours in occluded regions. To enhance visual realism of the reconstructed 3D face model, the Basel Face Model (BFM) UV texture map, a mean texture, and a texture projection technique are employed to generate facial skin textures. The reconstructed 3D faces are then integrated with the Skinned Multi-Person Linear (SMPL) body model to create complete 3D human avatars, followed by the attachment of an armature to enable skeletal animation. These avatars are subsequently deployed on the MANGOS platform, demonstrating the real-world applicability of this research.

View source

Similar papers

Review Open access Sep 2026

From a Single Image to a 3D Model: A Review of 3D Human Reconstruction from Monocular Images

In recent years, 3D human reconstruction technology has been widely applied across various industries such as digital humans, virtual reality, gaming, and film production. Among them, the task of generating a 3D human body model from a single two-dimensional image, known as single-image 3D human body reconstruction—pos...

Bo-Lin Guan · 0 citations
Preprint Nov 2026

ZARA: Zero-shot Animatable and Relightable 3D Avatar reconstruction from a single image

ZARA is presented, a zero-shot feed-forward framework that reconstructs an animatable 3D Gaussian avatar together with its intrinsic attributes from a single image, outperforming existing baselines in both relighting quality and materials generalization ability.

Yi-Xiao Chen, Dong-Dong Weng, Cheng-Feng Zhao et al. · 0 citations
Open access Oct 2026

M4Net for occlusion-robust 3D dense face alignment and cross-subject expression transfer with 3DMM and mask augmentation

Self-occlusion and external occlusion significantly affect the accuracy of monocular 3D dense face alignment (3DDFA). Although the 3D Morphable Model (3DMM) provides a simple and effective facial prior, existing 3DMM-based methods still suffer from limited robustness caused by the scarcity of facial occlusion data....

Xiong Zhao, Hua-Feng Qu, C. C. Neo et al. · 0 citations

UvA-DARE (Digital

Marcos Quintana, Sezer Karaoglu, F. Álvarez et al. · 0 citations
Open access 2026

Eye-Preserving 3D Face Registration Using Single-Image Reconstruction and Failure-Type Stratification

: Registering a textured 3D face mesh reconstructed from one image to a high-quality 3D face scan is challenging because the inputs come from different pipelines. Even for the same subject, they may differ in scale, pose convention, facial extent, expression, eye state, and artifacts. Minimizing nearest-neighbor surfac...

Moonki Park, Doheyon Park, Gunwoo Kim et al. · 0 citations
Book Open access Nov 2026

SelfieAvatar: High-Fidelity Animatable 3D Head Avatars from In-the-Wild Selfies

A Diffusion Transformer-based multi-view rectifier that canonicalizes the input selfies to predefined viewpoints while normalizing them to a shared facial expression is employed, which enables consistent multi-view facial animation with fine-grained expression preservation, including challenging motions such as tongue...

Zhen Tian, Zi-Yang Li, Yu-Zhen Jiang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.