masterhead masterhead  masterhead

Synchronized Video: An Interface for Harmonizing Video with Body Movements


Synchronized Video is a video control technique that shows frames in synchronization with real-world actions. Suitable video content for this type of video interface includes learning forms of exercise and assembly of structural objects. In the proposed system, the user feels as if he or she is standing in front of a strange mirror where there is a virtual human performing the correct actions in synchronization. Also, the proposed technology is effective for projecting target images onto real-world objects serving as a screen, for recreating the same situation as in prepared video content.

Fig. 1 Metaphor of Synchronized Video

The synchronization in this proposed interface is achieved without the user performing any explicit operations. The state created in the real world by the user is what directly controls the video. This design allows transparent video control for users. The intended frames could be provided intuitively in a continuous form.

Fig. 2 Prototype configuration



  1. Yoshihiro Watanabe, Hiroaki Ohno, Takashi Komuro, Masatoshi Ishikawa: Synchronized Video: An Interface for Harmonizing Video with Body Movements, 22nd Symposium on User Interface Software and Technology (UIST2009) (Victoria, 2009.10.5) / Adjunct Proceedings, pp.75-76. [PDF]
Ishikawa Group Laboratory, Data Science Research Division, Information Technology Center, University of Tokyo / Tokyo University of Science
Ishikawa Group Laboratory WWW admin: contact
Copyright © 2008 Ishikawa Group Laboratory. All rights reserved.