Uni-Tübingen

CRC 1233 “Robust Vision”

The collaborative research center “Robust Vision – Inference Principles and Neural Mechanisms” (CRC 1233) deals with basic principles of biological and machine vision, and is a close collaboration between scientists from the University and the Max Planck Institute for Intelligent Systems. Human visual perception is amazingly robust: Even in highly variable environments, we are able to make reliable inferences about the spatial arrangement of the world from limited visual information. To achieve this, our brain must perform complex computations. Artificial vision systems, in turn – as used, for example, in self-driving cars – are making steep progress in reproducing the visual skills of humans. The goal of this centre will be to better understand the principles and algorithms that enable robust visual inference both in humans and machines.


Topics, aims and projects

Key questions

In the third funding period, we will make extensive use both of advanced measurements of neural activity and behaviour, as well as our computational models from the first two funding periods, to study the inductive biases of visual systems that are essential for autonomous behaviour. Specifically, we will collaboratively work on the following key scientific questions and methodological challenges across all projects.

Scientifc key questions:

1. Which inductive biases and representations enable robust performance across multiple visual tasks in highly dynamic environments? In particular, (how) do visual agents use the natural structure of the world for robust performance?

2. What mechanisms underlie the efficiency of biological vision systems that enables autonomous behaviour? In particular, what is the role of active - and task-dependent - information-selection?

Methodological challenges:

1. How can we characterize the computations and mechanisms of biological vision systems with “digital twin” spanning different levels of biological plausibility? What data is needed to constrain such models, and how can they be used for mechanistic insights?

2. How can we compare intelligent visual behavior in brains and machines, in terms of representations, inductive biases and computations?

3. How can we generate a long-lasting and far-reaching scientific impact in the NeuroAI community through the provision of open-source models, evaluation-tools and data-repositories?


Overarching Research Themes:

Research Theme A: Object-centric vision

Project A1: Robust object perception - Unsupervised object-centric vision from video
PIs: Lensch, Geiger, Zhang, Koepke

Project A2: Evaluation of autonomous vision for agent-centric vision
PIs: Brendel, Akata


Research Theme B: Robust high-level vision in the human brain

Project B1: High-level visual and multi-modal representations in the human brain and ANNs
PIs: Liebe, Macke, Oganian

Project B2: Large scale neuronal interaction during natural vision
PIs: Siegel, Bartels

Project B3: Natural dynamic scene processing in the human brain - Large scale modular computation
PIs: Bartels, Bethge


Research Theme C: Active visual inference

Project C1: Prediction & model-building in uncertain environments
PIs: Franz, Dayan, Luxburg, Berens

Project C2: Early visual processing in the presence of eye movements - Benchmarking of active early vision
PIs: Wichmann, Kümmerer, Hafed, Schwarz


Research Theme D: Early information selection

Project D1: Exciting stimuli for mice and how they are encoded by the early visual system
PIs: Euler, Busse, Franke

Project D2: Collaborative, detail-on-demand models of information selection in a complete RGC population
PIs: Euler, Bethge, Macke

Project D3: Information selection in mouse dLGN and SC across internal and external contexts
PIs: Busse, Berens, Sinz, Franke


Supportive Project

Infrastructure Project: Software, methods and computational tools to evaluate computational models of vision
PIs: Eggensperger, Wichmann, Berens, Macke, Bethge


Spokespersons

Prof. Dr. Matthias Bethge

Tübingen AI Center
University of Tübingen
Maria-von-Linden-Straße 6
D-72076 Tübingen

+49 7071 29-70862
matthias.bethge@uni-tuebingen.de

Prof. Dr. Jakob Macke

Tübingen AI Center
University of Tübingen
Maria-von-Linden-Straße 6
D-72076 Tübingen

+49 7071 29-70850
jakob.mackespam prevention@uni-tuebingen.de

Dr. Katrin Franke

Institute for Ophthalmic Research
University of Tübingen
Elfriede-Aulhorn-Straße 7
72076 Tübingen

katrin.franke@uni-tuebingen.de

Partners