دورية أكاديمية

Modeling multi-style portrait relief from a single photograph

التفاصيل البيبلوغرافية
العنوان: Modeling multi-style portrait relief from a single photograph
المؤلفون: Yu-Wei Zhang, Hongguang Yang, Ping Luo, Zhi Li, Hui Liu, Zhongping Ji, Caiming Zhang
المصدر: Graphical Models, Vol 130, Iss , Pp 101210- (2023)
بيانات النشر: Elsevier, 2023.
سنة النشر: 2023
المجموعة: LCC:Science
LCC:Technology (General)
مصطلحات موضوعية: Portrait relief, Multi-style modeling, Swin Transformer, Photo-to-depth translation, Science, Technology (General), T1-995
الوصف: This paper aims at extending the method of Zhang et al. (2023) to produce not only portrait bas-reliefs from single photographs, but also high-depth reliefs with reasonable depth ordering. We cast this task as a problem of style-aware photo-to-depth translation, where the input is a photograph conditioned by a style vector and the output is a portrait relief with desired depth style. To construct ground-truth data for network training, we first propose an optimization-based method to synthesize high-depth reliefs from 3D portraits. Then, we train a normal-to-depth network to learn the mapping from normal maps to relief depths. After that, we use the trained network to generate high-depth relief samples using the provided normal maps from Zhang et al. (2023). As each normal map has pixel-wise photograph, we are able to establish correspondences between photographs and high-depth reliefs. By taking the bas-reliefs of Zhang et al. (2023), the new high-depth reliefs and their mixtures as target ground-truths, we finally train a encoder-to-decoder network to achieve style-aware relief modeling. Specially, the network is based on a U-shaped architecture, consisting of Swin Transformer blocks to process hierarchical deep features. Extensive experiments have demonstrated the effectiveness of the proposed method. Comparisons with previous works have verified its flexibility and state-of-the-art performance.
نوع الوثيقة: article
وصف الملف: electronic resource
اللغة: English
تدمد: 1524-0703
Relation: http://www.sciencedirect.com/science/article/pii/S1524070323000401; https://doaj.org/toc/1524-0703
DOI: 10.1016/j.gmod.2023.101210
URL الوصول: https://doaj.org/article/8ee129289d304affbca76c319d41d871
رقم الأكسشن: edsdoj.8ee129289d304affbca76c319d41d871
قاعدة البيانات: Directory of Open Access Journals
الوصف
تدمد:15240703
DOI:10.1016/j.gmod.2023.101210