Seminar: Neural Network Design Patterns in Computer Vision (5 ECTS)
Summer Semester 2024, TU München
Organiser: Roman Pflugfelder
Description
Computer vision considers models of neural networks initially invented by the machine learning community. This seminar allows the student to study neural networks in more detail. By the end of the seminar, all participants will understand the principles and the applications of selected models, and they will receive the ability to reuse these models as common design patterns in their future work.
Prerequisites
This seminar is for Master's students. Attending the course "Introduction to Deep Learning (I2DL) (IN2346)" in advance is recommended. Good scientific programming, e.g., Pytorch, Tensorflow, Jax and Flux, is not mandatory. Analytical skills and interest in paper reading and theory are necessary.
Schedule
The participants will collect a pool of successful neural networks, network architectures and network layers. After an individual choice, each student will read the respective paper publication to search for and study related papers. Based on the findings, the student will work out a short presentation (15 minutes), which will be given to the group. The students learn collaboratively about the model and the findings within a group discussion and feedback. After the presentations, the student will individually work out his findings, including written feedback, i.e., text, images, and videos. At the end of the seminar, the participants collect all these contributions into a final seminar report.
Registration
Assignment to the lab is done via the matching system.
Timeline
02.02.2024: Pre-seminar meeting (4 p.m. - 5 p.m., Zoom Link)23.04.2024: Kick-off meeting (4 p.m. - 5 p.m., room 5609.02.14)Exercise 1: Collect design patterns and the papers (online using Padlet)14.5.2024: Deadline of Exercise 1. Lecture 1 (5 p.m. - 6 p.m., Zoom)- Exercise 2: Study papers, do literature research, work out the presentation (individual Zoom meetings upon request)
4.6.2024: Lecture 2 (4 p.m. - 5 p.m., room 5609.03.014)2.7.2024: Deadline Exercise 2. Discussion Group (time 3 p.m. - 6 p.m., room 5609.01.14)4.7.2024: Continuing the Discussion Group (time 9 a.m. - 12 a.m., room 5609.02.23)- Exercise 3: Work out your contribution to the seminar report (individual Zoom meetings upon request)
23.7.2024: Deadline Exercise 3. Final Meeting (time 5 p.m. - 6 p.m., Zoom)
Material and Links
- Slides of the kick-off meeting (Password protected download URL)
Grading
- Participation during Exercise 1. Own selection of a design pattern (10%)
- Presentation of Exercise 2: structure, slides, clarity, depth, own understanding (30%)
- Contribution to the discussion (20%)
- Exercise 3: Contribution to the seminar report: structure, clarity, originality, understanding (40%)
I will consider your own programmed examples in the grading (+10%)