Head-mounted mixed reality systems are a popular development in human-computer interaction modalities. Theoretically based on MR systems (With the depth camera sensing the physical environment and the 3D glass rendering virtual elements) users can interact with any physical surface by touch, however optical methods have inherent disadvantages in detecting touch contact and precise contact locations (difficult for the camera to detect exactly when the finger touches the surface and the exact coordinates of the contact position of the touch point; high missed touch rate; spurious extra touch rate: system latency ). This project therefore explores a way to bypass the optical approach while also capturing the signal of accurate user touch contact and precise contact point location information. For the time being, the project is in the prototype testing phase of the sensor. The project then hopes to develop some interesting applications in MR systems based on the contact signal and contact point location information obtained by the product.
Qiqi Xie
I am a Chinese designer studying at the RCA. After my undergraduate studies I worked in the field of automation upgrades for the service industry and now my research at the RCA focuses on new ways of human-machine interaction and the use of new materials and structures in products. I believe that design needs to be commercial in order to make a real difference to the world.
