Drivable Avatar Clothing: Faithful Full-Body Telepresence with Dynamic Clothing Driven by Sparse RGB-D Input

التفاصيل البيبلوغرافية
العنوان: Drivable Avatar Clothing: Faithful Full-Body Telepresence with Dynamic Clothing Driven by Sparse RGB-D Input
المؤلفون: Xiang, Donglai, Prada, Fabian, Cao, Zhe, Guo, Kaiwen, Wu, Chenglei, Hodgins, Jessica, Bagautdinov, Timur
سنة النشر: 2023
المجموعة: Computer Science
مصطلحات موضوعية: Computer Science - Graphics, Computer Science - Computer Vision and Pattern Recognition
الوصف: Clothing is an important part of human appearance but challenging to model in photorealistic avatars. In this work we present avatars with dynamically moving loose clothing that can be faithfully driven by sparse RGB-D inputs as well as body and face motion. We propose a Neural Iterative Closest Point (N-ICP) algorithm that can efficiently track the coarse garment shape given sparse depth input. Given the coarse tracking results, the input RGB-D images are then remapped to texel-aligned features, which are fed into the drivable avatar models to faithfully reconstruct appearance details. We evaluate our method against recent image-driven synthesis baselines, and conduct a comprehensive analysis of the N-ICP algorithm. We demonstrate that our method can generalize to a novel testing environment, while preserving the ability to produce high-fidelity and faithful clothing dynamics and appearance.
Comment: SIGGRAPH Asia 2023 Conference Paper. Project website: https://xiangdonglai.github.io/www-sa23-drivable-clothing/
نوع الوثيقة: Working Paper
DOI: 10.1145/3610548.3618136
URL الوصول: http://arxiv.org/abs/2310.05917
رقم الأكسشن: edsarx.2310.05917
قاعدة البيانات: arXiv