These systems consist of a combination of different technologies such as robotics, extended, virtual and augmented reality, artificial intelligence, and sensors to measure the physiological response of the user. Multimodal interfaces allow to assist the user providing more information or guidance but can also help patients during therapy.

User operating the multimodal interface through the mixed reality Microsoft Hololens