Home >

news Help

Publication Information


Title
Japanese: 
English:Facial Expression Mapping inside Head Mounted Display by Embedded Optical Sensors 
Author
Japanese: 鈴木克洋, 中村文彦, 大塚慈雨, 正井克俊, 伊藤勇太, 杉本麻樹.  
English: Katsuhiro Suzuki, Fumihiko Nakamura, Jiu Otsuka, Katsutoshi Masai, Yuta Itoh, Maki Sugimoto.  
Language English 
Journal/Book name
Japanese: 
English:UIST '16 Adjunct: Proceedings of the 29th Annual Symposium on User Interface Software and Technology 
Volume, Number, Page         pp. 91-92
Published date Oct. 16, 2016 
Publisher
Japanese: 
English:ACM 
Conference name
Japanese: 
English:UIST '16 29th Annual Symposium on User Interface Software and Technology 
Conference site
Japanese: 
English:Tokyo 
DOI https://doi.org/10.1145/2984751.2985714
Abstract Head Mounted Display (HMD) provides an immersive ex-perience in virtual environments for various purposes such as for games and communication. However, it is difficult to capture facial expression in a HMD-based virtual environ-ment because the upper half of user's face is covered up by the HMD. In this paper, we propose a facial expression mapping technology between user and a virtual avatar using embedded optical sensors and machine learning. The distance between each sensor and surface of the face is measured by the optical sensors that are attached inside the HMD. Our system learns the sensor values of each facial expression by neural network and creates a classifier to estimate the current facial expression.

©2007 Tokyo Institute of Technology All rights reserved.