Computer Graphics & Facial Expression Control of 3D Avatar using Motion Data

KIPS Journal A (2001 ~ 2012) , Vol. 11A, No.5, pp.383-390, May 2004
10.3745/KIPSTA.2004.11A.5.383, Full Text

Abstract

This paper propose a method that controls facial expression of 3D avatar by having the user select a sequence of facial expressions in the space of facial expressions. And we setup its system. The space of expression is created from about 2400 frames consist of motion captured data of facial expressions. To represent the state of each expression, we use the distance matrix that represents the distances between pairs of feature points on the face. The set of distance matrices is used as the space of expressions. But this space is not such a space where one state can go to another state via the straight trajectory between them. We derive trajectories between two states from the captured set of expressions in an approximate manner. First, two states are regarded adjacent if the distance between their distance matrices is below a given threshold. Any two states are considered to have a trajectory between them if there is a sequence of adjacent states between them. It is assumed that one states goes to another state via the shortest trajectory between them. The shortest trajectories are found by dynamic programming. The space of facial expressions, as the set of distance matrices, is multidimensional. Facial expression of 3D avatar is controled in real time as the user navigates the space. To help this process, we visualized the space of expressions in 2D space by using the multidimensional scaling(MDS). To see how effective this system is, we had users control facial expressions of 3D avatar by using the system. As a result of that, users estimate that system is very useful to control facial expression of 3D avatar in real-time.


Statistics

Show / Hide Statistics

Statistics (Cumulative Counts from October 15, 2016)

Multiple requests among the same browser session are counted as one view. If you mouse over a chart, the values of data points will be shown.


Cite this paper

[KIPS Transactions Style]
S. H. Kim and M. R. Jung, "Computer Graphics & Facial Expression Control of 3D Avatar using Motion Data," KIPS Journal A (2001 ~ 2012) , Vol.11A, No.5, pp.383-390, 2004, DOI: 10.3745/KIPSTA.2004.11A.5.383.

[IEEE Style]
Sung Ho Kim and Moon Ryul Jung, "Computer Graphics & Facial Expression Control of 3D Avatar using Motion Data," KIPS Journal A (2001 ~ 2012) , vol. 11A, no. 5, pp. 383-390, 2004. DOI: 10.3745/KIPSTA.2004.11A.5.383.

[ACM Style]
Kim, S. H. and Jung, M. R. 2004. Computer Graphics & Facial Expression Control of 3D Avatar using Motion Data. KIPS Journal A (2001 ~ 2012) , 11A, 5, (2004), 383-390. DOI: 10.3745/KIPSTA.2004.11A.5.383.