Saltar apartados

Research Project

Multimodal Interaction in Pattern Recognition and Computer Vision

Summary of the project:

Social and industrial demands for Multimodal Interactive (MI) technologies and advanced man- machine interfaces have dramatically increased in the last decade. While the highly relevant role of Pattern Recognition (PR) and Computer Vision (CV) in the development of these MI tech- nologies and interfaces was already foreseen in the early seventies, only a very small fraction of this huge potential has been exploited so far. Tapping this potential entails several research chal- lenges and opportunities in order to adapt PR and CV approaches to the dynamic and changing environments of interactive systems. This project aims to establish a research program to ex- plore all these opportunities and challenges. In particular, three main oportunities are identified: a) to take direct advantage of the feedback information provided by the user in each interaction step to improve raw performance, b) to use feedback-derived data to adaptively (re-)train the system and tune it to the user behaviour and the specific task considered and c) to acknowledge the inherent multimodality of interaction to improve overall system behaviour and usability. Adequate ways to develop these oportunities are presented as a natural evolution of classical (probabilistic) approaches to PR and CV problems. Based on these approaches, a number of important applications of MI, PR and CV systems are discussed and a work plan is established to develop these approaches and applications in a five years time-frame. The ultimate goal is to show how existing PR and CV technologies can naturally evolve to help the development of advanced multi-modal interactive systems that will realize the long standing promises of a seamless synergy between persons and machines. The research consortium that has been consti- tuted to achieve this goal is composed of 81 highly qualified scientists and engineers from seven research groups and ten different public research institutions. This staff includes many inter- nationally renowned researchers in the fields of Pattern Recognition, Machine Learning, Image Processing, Computer Vision, Speech and Language Processing and Robotics.

Departament of Software and Computing Systems

University of Alicante, carretera San Vicente s/n

03690 San Vicente del Raspeig, Alicante (Spain)

Tel: (+34) 96 590 3772

Follow us on:

[Twitter] [Facebook]