Lumipen: Projection Mapping on a Moving Object

Summary

Projection mapping technology is a highly anticipated area, which has been used for mere optical effects or interactive AR applications. However, until now mainly static objects, such as things placed on tables, walls, floors or desk surfaces, have been subjected to the projected information. Dynamic scenes and high-speed objects have not been dealt with. Even if this was tried using a traditional projection mapping system, there would be a misalignment between the target and the projection due to delay in the system.

Therefore, we propose an unprecedented projection mapping technology aimed at moving targets, which is achieved by means of a high-speed vision system capable of capturing a thousand images per second and a high-speed optical device, called Saccade Mirror. This device was originally designed to keep the camera gaze fixed at a dynamic target (cf. 1 ms Auto Pan-tilt). In our projection mapping system, the projector and camera are coaxially aligned in the Saccade Mirror which provides a misalignment free projection that previously was considered to be difficult. This technology is named "Lumipen" after an imaginary pen with illumination instead of ink, where arbitrary patterns can be depicted. Fig. 1 and Fig. 2 indicate the concept of Lumipen and a scene of projecting some patterns on a moving ball respectively.

Fig.1 System Configuration.	Fig.2 Projecting an image on a dynamic ball.

Movie

Reference

1. Kohei Okumura, Hiromasa Oku and Masatoshi Ishikawa: Acitve Projection AR using High-speed Optical Axis Control and Appearance Estimation Algorithm, 2013 IEEE International Conference on Multimedia and Expo (ICME 2013) (San Jose, 2013.7.18) [PDF (3.5kB)]
2. Kohei Okumura, Hiromasa Oku and Masatoshi Ishikawa: High-Speed Gaze Controller for Millisecond-order Pan/tilt Camera, 2011 IEEE International Conference on Robotics and Automation (ICRA 2011) (Shanghai, 2011.5.12) / Conference Proceedings, pp.6186-6191 [PDF (1.3MB)]