Urban contextual information interfaces with multimodal augmented reality

We will develop methods and a pilot system for context-dependent search and presentation of information with the means of augmented reality. Information associated to physical objects and situations can be accessed and then aligned with the real environment for visual and auditory display. The user's context and foci of interest are measured with wearable cameras and eye tracking. Novel statistical machine learning methods are used for multimodal information retrieval and for taking the context into account.

The main applications considered in this project are in urban planning, design and construction, studies and enhancement of social interaction, and in creating a personal assistant that supports information retrieval, media access, and memory.

Partners

• Adaptive Informatics Research Centre: prof. Samuel Kaski, docent Mikko Kurimo, docent Jorma Laaksonen
• Department of Media Technology: prof. Lauri Savioja, prof. Tapio Takala, prof. Pirkko Oittinen, prof. Hannu Saarelma
• Department of Signal Processing and Acoustics: prof. Matti Karjalainen
• Brain Research Unit of the Low Temperature Laboratory: prof. Riitta Hari
• Department of Architecture: prof. Kimmo Lapintie, prof. Tor-Ulf Weck, Hannu Penttilä