Identity-Consistent Expression Fields (ICEF) is proposed, a framework that explicitly disentangles a static, identity-specific radiance component from a dynamic, expression-conditioned deformation component, and introduces an identity preservation regularizer that constrains the deformation network to modify only expression-relevant regions while leaving identity-specific canonical appearance untouched.
Abstract
Neural Radiance Fields (NeRF) have enabled photorealistic novel-view synthesis of 3D scenes and, in the facial domain, have been extended to reconstruct and animate 3D face models from a small number of images. However, existing few-shot dynamic NeRF methods for facial expression editing typically warp a single learned feature volume conditioned on target expression parameters, which can cause identity-specific appearance details (skin texture, fine geometric structure) to drift when the model is driven toward expressions far from those seen in the few-shot input set. We propose Identity-Consistent Expression Fields (ICEF), a framework that explicitly disentangles a static, identity-specific radiance component from a dynamic, expression-conditioned deformation component, and introduces an identity preservation regularizer that constrains the deformation network to modify only expression-relevant regions while leaving identity-specific canonical appearance untouched. ICEF further incorporates a confidence-weighted conditional feature warping step that down-weights unreliable warps for target expressions that are far, in parameter space, from the observed few-shot inputs, mitigating artifacts observed in prior few-shot dynamic NeRF methods when extrapolating to novel expressions. We relate ICEF to prior few-shot dynamic NeRF, static 3D-aware face generation, and disentangled face-editing radiance field methods, and describe an evaluation protocol measuring both novel-expression rendering quality and, specifically, identity-consistency metrics across a range of expression-parameter extrapolation distances.
—The reconstruction of photorealistic 4D faces from monocular video holds significant importance for applications such as virtual reality and digital human-robot interaction. However, achieving reconstructions with structurally reasonable facial geometry and natural expressions remains challenging. Existing approaches...
Hao Yu, Hui Yu, Rachael E. Jack et al.· IEEE Transactions on Computa...· 0 citations
These results establish frozen DINOv3 as a strong zero-shot representation for region-level facial correspondence and identify intermediate self-supervised features as the most useful layer for dense face analysis.
Izaldein Al-Zyoud, Abdulmotaleb El Saddik· arXiv.org· 0 citations
Sketch-text-driven rectified flow (STDRF), a conditional rectified-flow framework for identity-preserving and semantically controllable 4D face generation, and a sketch encoder enhanced by Geometric Contour and Texture Detail preprocessing and MixStyle domain adaptation are proposed.
Baodong Wang, Fang Liu, Wei Cao et al.· The Visual Computer· 0 citations
Dynamic 3D Gaussian Splatting (3DGS) enables efficient facial-avatar rendering but may suffer from cumulative geometric drift and degradation of identity-specific details when applied to long monocular sequences. To address this problem, we propose IA-3DGS, an identity-anchored dynamic Gaussian framework for long-term...
Ze-Wei Zhao, L. Yin, Shuaijie Wang et al.· Italian National Conference...· 0 citations
A generative appearance model where a $\beta$-VAE learns a structured and continuous manifold of global appearance is introduced, Conditioned on the latent code, a 3D neural appearance field is constructed that generates dynamic Tri-Plane features to encode spatially-varying local illumination effects.
Yu Bai, Qian-Qiu Tan, Li-Long Chen et al.· 0 citations
A deep learning framework is proposed to directly predict re-topologized facial meshes from synthetic multiview images generated with Visage Craft, an in-house physically based rendering system using an Appearance 3D Morphable Model (A3DMM).
Xiang Li· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.