Enhancing cognition and motor rehabilitation using mixed reality

Technological advancements based on mixed reality (MR) offer various challenges for research and medical treatment. The project focuses on two objectives related to healthy subjects and hemiparetic patients after stroke. First, we will test the hypothesis whether cognitive training using appropriately designed MR environment will enhance perceptual and cognitive performance in healthy subjects. This will be tested by computerized psychological experiments as well as by measuring event-related potentials or ERPs. Second, we will test the hypothesis whether experience with training in MR (in combination with motor-imagery based brain-computer interface developed by us) will enhance oscillatory sensory-motor rhythms. This will be tested by measuring subject’s EEG activity before and after each training session, clinical testing, as well as by the questionnaires aiming to learn about human factors including mental fatigue, motivation, irritation or sleepiness due to training. In both objectives, we will design and implement a set of testing procedures, carry out a battery of dedicated experiments, and critically evaluate the results with the goal to validate MR designs.