'Out of the Box' - Synthesizing Historical Fashion for Virtual Production, XR, and Games via Generative Re-imagination and 4DGS

Abstract

We present a lightweight production pipeline that transforms fragile historical costumes into dynamic digital assets using Generative Re-imagination to bridge the gap between restricted physical archives and production requirements. Our key insight is that labor-intensivke physical scanning and multi-camera photogrammetric capture can be replaced by AI-generated virtual views, which serve as the foundation for 3DGS model creation. We introduce a novel method to unify these partial 3DGS models into seamless temporal representations (4DGS), termed Blended 3DGS, and demonstrate the framework's versatility in the context of digital actor pipelines for costume design and facial animation, as well as virtual period fashion for Virtual Productions.