High Speed Gesture UI for Three Dimensional Display zSpace

Summary

This system integrates high speed 3D hand gesture interface and 3D virtual holographic display system. Ishikawa-Watanabe Laboratory developed the high speed 3D hand gesture interface which detects the 3d position of user's hand and recognizes gestures. zSpace®(*Note2) developed the zSpace(*Note1) 3D display system. Integrating the two systems, an immersive virtual environment can be realized. The high speed 3D hand gesture interface utilizes super high speed stereo cameras, which makes it possible to recognize gesture and track 3D position (500 fps) with extremely small latency. With such small latency, very fast and tiny movements, such as shaking, can be detected easily. Not only fast, the system is also correctly aligned with the real world, making the interaction very intuitive.

In other systems, such as smart phones, tablets, computers, etc., the response time have significant influence on user satisfaction. Devices with high latency create some sense of incongruity, which makes the experience unenjoyable. Low latency response not only removes that sense of incongruity, but also gives a feeling of being immersed in the virtual environment.

Low restriction and low latency brings various application. Progress in 3D image operativity brings intuitive interaction and high efficiency. This system is expected to be applied in situations like surgical operation, because user can operate 3D image without touching anything. Creativity is pulled out to the utmost, because any devices don't interfere operator's creativity.

zSpace is a leading-edge technology provider that delivers a new way of learning with its flagship product, zSpace. Focused on the learning market, specifically science, technology, engineering and math (STEM) education, medical instruction, corporate training and research, zSpace inspires and accelerates understanding through immersive exploration. zSpace is a privately held, venture backed company located in Sunnyvale, CA, and has filed more than 30 patents for its innovative technologies. (http://zspace.com/)

zSpace® provide 3D image to a operator wearing trackable glasses showing deferent images to both eyes. A virtual reality environment for immersive exploration, visualization, and learning. Unleash the full potential of human understanding. zSpace is an immersive, interactive hardware and software platform for students, educators, researchers, and corporate trainers. zSpace gives depth to the digital learning experience by improving the way things are studied, explored, designed and visualized. (http://zspace.com/the-zspace-system/)

Fig.1 System		Fig.2 The whole system

Fig.3 High speed 3D gesture recognition system		Fig.4 Manipulation with hands

Movie

Reference

• Muhammad Sakti Alvissalim, Masahiko Yasui, Chihiro Watanabe, and Masatoshi Ishikawa: Immersive Virtual 3D Environment based on 499 fps Hand Gesture Interface, ICACSIS 2014