Simultaneous High-speed Depth Measurement and Video Presentation using a Video-rate Projector

Summary

This paper proposes a method to simultaneously realize video presentation and high-speed depth measurement using a single projector-camera system with a general video-rate projector. Some applications in the XR field require real-time depth measurement at high frame rates along with video projection. However, the quality of the video presentation will be degraded and depth measurement will be low speed when a video-rate projector is used as it is for both purposes at the same time.

On the other hand, since the driving frequency of the DMD of a general DLP projector far exceeds the video rate, it has the potential to achieve high-speed depth measurement while presenting images by using a specialized projection strategy. We propose a method to decompose a target image into low-bit images and demonstrate that an actual system using the proposed method can perform depth measurement at 1,000 fps while projecting images at the video rate.

Fig. 1 Low-bit image decomposition

Fig. 2 Proposed projection strategy

Fig. 3 Target projection image	Fig. 4 Projection result (Image at the video rate)
Fig. 5 Projection onto a target object	Fig. 6 Measurement result（3D point cloud obtained at 1,000fps）

References

1. Leo Miyashita, Satoshi Tabata and Masatoshi Ishikawa: Hierarchical ArUco Marker Array for Coarse-to-Fine Localization in XR applications, IEEE International Conference on Artificial Intelligence & eXtended and Virtual Reality (AIxVR2025), pp.209-212, Lisbon, Portugal, 27-29 Jan. (2025)