The team’s research is aiming at photo-realism in acquiring high resolution, very accurate 3D models that capture the geometry and the appearance of the real world with the goal to enable photorealistic relighting and finally photorealistic rendering. To achieve that goal specific acquisition methods and technology are developed by combining optics, camera design, and image processing in the field of computational photography. Reconstructing the photorealistic model from captured data including the reflection properties is the next challenge. Robust reconstruction calls for intelligent, and highly efficient approaches which can only be achieved by combining GPGPU programming with advanced machine learning. Similarly, the reconstruction is tightly coupled to efficient rendering where we particularly address challenging light transport scenarios. A newer trend combines text and visual information in order to explore how both modalities can support each other, e.g. in language grounding or in creating graphics and scenes from textual descriptions.
Team: Raphael Braun, Andreas Engelhardt, Lukas Ruppert, Arjun Majumdar, Faezeh Zakeri
The core competence of the team is in the acquisition, rendering, and display of photo realistic 3D models of real-world objects and scenes. In order to fully capture the appearance, both the 3D geometry as well as the light transport characteristics, i.e., the view and illumination dependent reflection properties, have to be measured precisely. The current focus is on the acquisition outside of a lab environment or the acquisition of multispectral reflectance. In addition, capturing the reflectance of moving, dynamic objects is still to be solved.
Besides acquiring reflection properties we also work on rendering them efficiently in complex global illumination settings, e.g. using path guiding.
Team: Andreas Engelhardt, Arjun Majumdar, Raphael Braun, Alexander Oberdörster
Beyond traditional ways of taking pictures, the group is researching novel cameras and algorithms. By modifying the optics, the sensor, and by combining multiple different sensors paired with powerful algorithms it is possible to acquire better pictures or pictures showing other modes rather than color. By employing programmable diffractive optics we can shape the PSF of a camera. In such a way, images might be refocused after capture, the contrast might be increased while reducing noise in HDR images. One can capture 3D geometry from image collections and videos, or capture aspects that otherwise are invisible, i.e. temporal, polarization, or wavelength effects. By coupling cameras with projectors and compute power the additional information can also be visualized on real-world surfaces.
Team: Lukas Ruppert, Raphael Braun
Besides the traditional topic of real-time rendering on graphics cards our research focus on using the massive parallelism in modern GPUs with thousands of cores for supporting general purpose computing. All aspects of designing algorithms on massively parallel platforms are of interest. For example, we employ GPUs for the simulation of particular visual effects such as diffraction, fluorescence, and alike, to perform advanced image processing in real-time. In addition, the group works on general purpose GPU (GPGPU) applications, for example, highly efficient nearest neighbor search in high-dimensional spaces based on product quantization or hierarchical kNN graphs.
Team: Hassan Shahmohammadi, Zohreh Ghaderi, Leonard Salewski
Linking images and natural language opens new application scenarios. For one, providing a natural language interface to the visual world enables localization and reasoning about everyday objects in our environment. This includes visual grounding of word embeddings, video captioning, or visual Q&A including explanation generation. Furthermore, by closely analyzing the semantics of objects and by interpreting scenes we work on automatically translating text into visual representations. A key ingredient is harvesting multiple knowledge sources both in form of texts as well as image and video databases, with the focus to strengthen both the graphics/vision understanding as well as solving psycho-linguistic questions.
Team: Zohreh Ghaderi, Raphael Braun, Simon Holdenried-Krafft, Simon Doll, Sarah Müller
Many image and video processing algorithms have to deal with constantly changing input data as each frame might show different content in a different illumination. We apply machine learning architectures such as deep convolutional neural networks, recurrent networks, Transformer, and alike to enable novel information extraction and enhancement applications. They include image and video deblurring, road lane prediction, appearance robust similarity estimations, measuring aesthetics, or analyzing retinal fundus images and whole-slide images in pathology.
Our website uses cookies. Some of them are mandatory, while others allow us to improve your user experience on our website. The settings you have made can be edited at any time.
or
Essential
in2cookiemodal-selection
Required to save the user selection of the cookie settings.
3 months
be_lastLoginProvider
Required for the TYPO3 backend login to determine the time of the last login.
3 months
be_typo_user
This cookie tells the website whether a visitor is logged into the TYPO3 backend and has the rights to manage it.
Browser session
ROUTEID
These cookies are set to always direct the user to the same server.
Browser session
fe_typo_user
Enables frontend login.
Browser session
Videos
iframeswitch
Used to show all third-party contents.
3 months
yt-player-bandaid-host
Is used to display YouTube videos.
Persistent
yt-player-bandwidth
Is used to determine the optimal video quality based on the visitor's device and network settings.
Persistent
yt-remote-connected-devices
Saves the settings of the user's video player using embedded YouTube video.
Persistent
yt-remote-device-id
Saves the settings of the user's video player using embedded YouTube video.
Persistent
yt-player-headers-readable
Collects data about visitors' interaction with the site's video content - This data is used to make the site's video content more relevant to the visitor.
Persistent
yt-player-volume
Is used to save volume preferences for YouTube videos.
Persistent
yt-player-quality
Is used to save the quality settings for YouTube videos.
Persistent
yt-remote-session-name
Saves the settings of the user's video player using embedded YouTube video.
Browser session
yt-remote-session-app
Saves the settings of the user's video player using embedded YouTube video.
Browser session
yt-remote-fast-check-period
Saves the settings of the user's video player using embedded YouTube video.
Browser session
yt-remote-cast-installed
Saves the user settings when retrieving a YouTube video integrated on other web pages
Browser session
yt-remote-cast-available
Saves user settings when retrieving integrated YouTube videos.
Browser session
ANID
Used for targeting purposes to profile the interests of website visitors in order to display relevant and personalized Google advertising.
2 years
SNID
Google Maps - Google uses these cookies to store user preferences and information when you view pages with Google Maps.
1 month
SSID
Used to store information about how you use the site and what advertisements you saw before visiting this site, and to customize advertising on Google resources by remembering your recent searches, your previous interactions with an advertiser's ads or search results, and your visits to an advertiser's site.
6 months
1P_JAR
This cookie is used to support Google's advertising services.
1 month
SAPISID
Used for targeting purposes to profile the interests of website visitors in order to display relevant and personalized Google advertising.
2 years
APISID
Used for targeting purposes to profile the interests of website visitors in order to display relevant and personalized Google advertising.
6 months
HSID
Includes encrypted entries of your Google account and last login time to protect against attacks and data theft from form entries.
2 years
SID
Used for security purposes to store digitally signed and encrypted records of a user's Google Account ID and last login time, enabling Google to authenticate users, prevent fraudulent use of login credentials, and protect user data from unauthorized parties. This may also be used for targeting purposes to display relevant and personalized advertising content.
6 months
SIDCC
This cookie stores information about user settings and information for Google Maps.
3 months
NID
The NID cookie contains a unique ID that Google uses to store your preferences and other information.
6 months
CONSENT
This cookie tracks how you use a website to show you advertisements that may be of interest to you.
18 years
__Secure-3PAPISID
This cookie is used to support Google's advertising services.
2 years
__Secure-3PSID
This cookie is used to support Google's advertising services.
6 months
__Secure-3PSIDCC
This cookie is used to support Google's advertising services.
6 months