Concise and Effective Network for 3D Human Modeling From Orthogonal SilhouettesSource: Journal of Computing and Information Science in Engineering:;2022:;volume( 022 ):;issue: 005::page 51004-1DOI: 10.1115/1.4054001Publisher: The American Society of Mechanical Engineers (ASME)
Abstract: In this article, we revisit the problem of 3D human modeling from two orthogonal silhouettes of individuals (i.e., front and side views). Different from our previous work (Wang et al. (2003, “Virtual Human Modeling From Photographs for Garment Industry,” Comput. Aided Des., 35, pp. 577–589).), a supervised learning approach based on the convolutional neural network (CNN) is investigated to solve the problem by establishing a mapping function that can effectively extract features from two silhouettes and fuse them into coefficients in the shape space of human bodies. A new CNN structure is proposed in our work to extract not only the discriminative features of front and side views but also their mixed features for the mapping function. 3D human models with high accuracy are synthesized from coefficients generated by the mapping function. Existing CNN approaches for 3D human modeling usually learn a large number of parameters (from 8.5 M to 355.4 M) from two binary images. Differently, we investigate a new network architecture and conduct the samples on silhouettes as the input. As a consequence, more accurate models can be generated by our network with only 2.4 M coefficients. The training of our network is conducted on samples obtained by augmenting a publicly accessible dataset. Learning transfer by using datasets with a smaller number of scanned models is applied to our network to enable the function of generating results with gender-oriented (or geographical) patterns.
|
Show full item record
contributor author | Liu, Bin | |
contributor author | Liu, Xiuping | |
contributor author | Yang, Zhixin | |
contributor author | Wang, Charlie C. L. | |
date accessioned | 2022-05-08T09:32:06Z | |
date available | 2022-05-08T09:32:06Z | |
date copyright | 3/31/2022 12:00:00 AM | |
date issued | 2022 | |
identifier issn | 1530-9827 | |
identifier other | jcise_22_5_051004.pdf | |
identifier uri | http://yetl.yabesh.ir/yetl1/handle/yetl/4285250 | |
description abstract | In this article, we revisit the problem of 3D human modeling from two orthogonal silhouettes of individuals (i.e., front and side views). Different from our previous work (Wang et al. (2003, “Virtual Human Modeling From Photographs for Garment Industry,” Comput. Aided Des., 35, pp. 577–589).), a supervised learning approach based on the convolutional neural network (CNN) is investigated to solve the problem by establishing a mapping function that can effectively extract features from two silhouettes and fuse them into coefficients in the shape space of human bodies. A new CNN structure is proposed in our work to extract not only the discriminative features of front and side views but also their mixed features for the mapping function. 3D human models with high accuracy are synthesized from coefficients generated by the mapping function. Existing CNN approaches for 3D human modeling usually learn a large number of parameters (from 8.5 M to 355.4 M) from two binary images. Differently, we investigate a new network architecture and conduct the samples on silhouettes as the input. As a consequence, more accurate models can be generated by our network with only 2.4 M coefficients. The training of our network is conducted on samples obtained by augmenting a publicly accessible dataset. Learning transfer by using datasets with a smaller number of scanned models is applied to our network to enable the function of generating results with gender-oriented (or geographical) patterns. | |
publisher | The American Society of Mechanical Engineers (ASME) | |
title | Concise and Effective Network for 3D Human Modeling From Orthogonal Silhouettes | |
type | Journal Paper | |
journal volume | 22 | |
journal issue | 5 | |
journal title | Journal of Computing and Information Science in Engineering | |
identifier doi | 10.1115/1.4054001 | |
journal fristpage | 51004-1 | |
journal lastpage | 51004-11 | |
page | 11 | |
tree | Journal of Computing and Information Science in Engineering:;2022:;volume( 022 ):;issue: 005 | |
contenttype | Fulltext |