masterhead masterhead  masterhead

Coloring Drawing System using High-speed Coaxial Control and Active Marking


Recently, coloring drawing system for presenting a pattern on the surface of a dye-coated object using a chemical reaction called chromism, which causes the color of the dye to change by irradiation with light or heat, have been actively researched. Above all, the phenomenon using light irradiation is called photochromism. Since the pattern can be erased and rewritten repeatedly, there are applications such as changing the design and testing the pattern of the object. Furthermore, drawing technology for 3D objects of various shapes is expected to be non-contact printing. However, in the conventional method, the pose recognition method is not suitable for the object to be drawn, and there is a problem of the complicated calibration of the optical system.

In this research, we propose a coloring drawing optical system of laser-camera high-speed coaxial control and active marking that draws multiple rewritable markers onto the object's surface using photochromism for the recognition of the object's dynamic posture and the accurate drawing onto the object's surface, as shown in Fig. 1. Calibration is simplified because the laser drawing position is always fixed within the camera angle of view by laser-camera coaxial control. The drawing area is expanded by drawing multiple dot markers spirally using a laser and two-axis mirror control, centering four initial markers which are manually placed beforehand. Then, the object's posture is estimated using the markers detected in the image processing, and highly accurate drawing of markers and pictures is performed.

Since the camera captures at a high resolution with a narrow angle of view, the marker drawing, detection, and posture estimation is highly accurate. In addition, high-speed processing enables drawing even to the moving object, that is, the posture-changing object, leading to all-around drawing. It was confirmed that the drawing results for both a static and a rotating planar object were highly accurate (Fig. 2), and the drawing for a cylinder (a symmetrical object) was also precise enough (Fig. 3). Because it is possible to pattern 3D symmetrical objects, it is expected to be applied to customized coloring and additional processing of daily necessities such as cups containing glassware.

Fig.1 System configuration.
Fig.2 Drawn appearance and evaluation result of plane objects.

Fig.3 Drawn appearance of a cylinder (a rotationally symmetric object).


  1. Yuri Mikawa, Tomohiro Sueishi, Tomohiko Hayakawa, Masatoshi Ishikawa: Laser-based drawing method for posture-free objects by photochromic active marking with high-speed coaxial gaze control, SPIE Photonics West 2020 (San Francisco, California, USA. 2020.02.05)/ Oral Session
  2. Yuri Mikawa, Tomohiro Sueishi, Tomohiko Hayakawa and Masatoshi Ishikawa: Laser-based Photochromic Drawing Method for Rotating Objects with High-speed Visual Feedback, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Osaka, Japan, 23-27 Mar. (2019) / Poster
Ishikawa Group Laboratory, Data Science Research Division, Information Technology Center, University of Tokyo
Ishikawa Group Laboratory WWW admin: contact
Copyright © 2008 Ishikawa Group Laboratory. All rights reserved.