Deep Learning

Lecturer Prof. Dr. Andreas Zell
Dates/Time Wednesdays 14:15 - 16:00


3V+1Ü (6 LP)

Start Wednesday 18.10.2023
Location Morgenstelle, Hörsaal N5
Zoom Stream
Cycle annually during the winter semester
Final Exam Wednesday 14.02.2024, 14:15 - 16:00

In Alma-Vorlesungsverzeichnis



The lecture will cover the main principles and models of "deep neural networks", adapted from the textbook "Deep Learning" by Goodfellow, Bengio and Courville. These network models are currently top performers in recognition for many machine learning problems, from object recognition, image segmentation, speech recognition, handwriting recognition, to time series analysis. They are used for autonomous driving, by internet companies for semantic labeling of image data, and in mobile assistants such as Siri, Cortana, and Google Now.

After an introduction to the topic, deep neural networks and techniques such as backpropagation are covered; followed by regularization techniques for deep neural networks (which improve their generalization performance on unknown test data). This is followed by optimization techniques for training deep neural networks and a chapter on convolutional neural networks (CNNs). Further chapters on recurrent networks and autoencoders follow. At the end, very recent architectures like transformers, large language models, generative models and applications will be treated.

In the exercises, the theoretical knowledge acquired in the lecture will also be deepened by theoretical questions and practical tasks. In addition to programming tasks in Python, the deep learning library PyTorch from Facebook will be used.


The lecture is intended for master students!
Good knowledge of mathematics I - III (linear algebra, statistics, numerics) is required.
The material is very extensive and contains many formulas (and too much text on the slides).
Python programming skills are assumed.

Registration (Mandatory):

Via Moodle: Deep Learning


  • Lecture notes (will be made available as PDF in Moodle before the lecture)
  • Ian Goodfellow, Yoshua Bengio, Aaron de Courville: Deep Learning, MIT Press, 2016.The book is available online on the WWW, cf.

Exercises for the lecture Deep Neural Networks

Teaching Assistants: Benjamin Kiefer, Boya Zhang, Yitong Quan, Hannah Frank
Office hours: usually in the exercise, in exceptional cases by arrangement
Date/time: Wed. 16:15 - 18:00 (sometimes the exercise is used for the lecture as well)
Place: Morgenstelle, Hörsaal N5

In parallel, the session is streamed via Zoom: TBA

Issue of the exercise sheets: via Moodle
Submission of the completed exercise sheets: none, solutions will be presented one week after issue