Retargeting Human-Object Interaction to Virtual Avatars

IEEE Transactions on Visualization and Computer Graphics (Proceedings of ISMAR 2016)
Yeonjoon Kim, Hangil Park, Seungbae Bang, and Sung-Hee Lee


In augmented reality (AR) applications, a virtual avatar serves as a useful medium to represent a human in a different place. This paper deals with the problem of retargeting a human motion to an avatar. In particular, we present a novel method that retargets a human motion with respect to an object to that of an avatar with respect to a different object of a similar shape. To achieve this, we developed a spatial map that defines the correspondences between any points in the 3D spaces around the respective objects. The key advantage of the spatial map is that it identifies the desired locations of the avatar’s body parts for any input motion of a human. Once the spatial map is created offline, the motion retargeting can be performed in real-time. The retargeted motion preserves important features of the original motion such as the human pose and the spatial relation with the object. We report the results of a number of experiments that demonstrate the effectiveness of the proposed method.


[PAPER] — 6.55mb PDF


author={Y. Kim and H. Park and S. Bang and S.-H. Lee}, 
journal={IEEE Transactions on Visualization and Computer Graphics}, 
title={Retargeting Human-Object Interaction to Virtual Avatars}, 
keywords={Avatars;Geometry;Mesh generation;Real-time systems;Shape;Three-dimensional displays;Trajectory;Motion retargeting;augmented reality;avatar animation;human-object interaction;telepresence},