This thesis comprehensively investigates the contributions of all the loss functions to 3D face reconstruction through quantitative and qualitative analyses, and introduces a landmark mirroring strategy to improve the recovery of facial contours in occluded regions.
Abstract
Three-dimensional (3D) face reconstruction from a single two-dimensional (2D) image enables the creation of personalized 3D avatars that preserve facial identity for immersive applications in the metaverse. This thesis aims to develop a realistic 3D human avatar generation framework for the metaverse platform MANGOs (Metaverse of Academic Nexus for Global Opportunities). The framework employs the Faces Learned with an Articulated Model and Expressions (FLAME) model as the underlying parametric 3D representation of face to represent facial shape, pose, and expression. Inspired by Detailed Expression Capture and Animation (DECA), which reconstructs 3D facial geometry from a single 2D image without requiring explicit 3D ground-truth supervision, this thesis comprehensively investigates the contributions of all the loss functions to 3D face reconstruction through quantitative and qualitative analyses. This work is evaluated on the NOW benchmark using both non-metrical and metrical reconstruction protocols to assess the robustness and accuracy of the reconstruction framework. In addition, this thesis introduces a landmark mirroring strategy to improve the recovery of facial contours in occluded regions. To enhance visual realism of the reconstructed 3D face model, the Basel Face Model (BFM) UV texture map, a mean texture, and a texture projection technique are employed to generate facial skin textures. The reconstructed 3D faces are then integrated with the Skinned Multi-Person Linear (SMPL) body model to create complete 3D human avatars, followed by the attachment of an armature to enable skeletal animation. These avatars are subsequently deployed on the MANGOS platform, demonstrating the real-world applicability of this research.
In recent years, 3D human reconstruction technology has been widely applied across various industries such as digital humans, virtual reality, gaming, and film production. Among them, the task of generating a 3D human body model from a single two-dimensional image, known as single-image 3D human body reconstruction—pos...
Bo-Lin Guan· Applied and Computational En...· 0 citations
ZARA is presented, a zero-shot feed-forward framework that reconstructs an animatable 3D Gaussian avatar together with its intrinsic attributes from a single image, outperforming existing baselines in both relighting quality and materials generalization ability.
Yi-Xiao Chen, Dong-Dong Weng, Cheng-Feng Zhao et al.· 0 citations
Self-occlusion and external occlusion significantly affect the accuracy of monocular 3D dense face alignment (3DDFA). Although the 3D Morphable Model (3DMM) provides a simple and effective facial prior, existing 3DMM-based methods still suffer from limited robustness caused by the scarcity of facial occlusion data....
Xiong Zhao, Hua-Feng Qu, C. C. Neo et al.· Scientific Reports· 0 citations
: Registering a textured 3D face mesh reconstructed from one image to a high-quality 3D face scan is challenging because the inputs come from different pipelines. Even for the same subject, they may differ in scale, pose convention, facial extent, expression, eye state, and artifacts. Minimizing nearest-neighbor surfac...
Moonki Park, Doheyon Park, Gunwoo Kim et al.· Computer Modeling in Enginee...· 0 citations
A Diffusion Transformer-based multi-view rectifier that canonicalizes the input selfies to predefined viewpoints while normalizing them to a shared facial expression is employed, which enables consistent multi-view facial animation with fine-grained expression preservation, including challenging motions such as tongue...
Zhen Tian, Zi-Yang Li, Yu-Zhen Jiang et al.· Proceedings of the 34th ACM...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.