Skip to content

Latest commit

 

History

History
59 lines (39 loc) · 10.4 KB

index.md

File metadata and controls

59 lines (39 loc) · 10.4 KB

Deep Learning (CAS machine intelligence, 2021 )

This course in deep learning focuses on practical aspects of deep learning. We therefore provide jupyter notebooks (complete overview of all notebooks used in the course).

For doing the hands-on part we recommend to use colab (you might need a google account) an internet connections is needed. If you want to do it without internet connection on your own computer you can either install anaconda (details and installation instruction) or use the provided a docker container (details and installation instruction).

To easily follow the course please make sure that you are familiar with the some basic math and python skills.

Info for the projects

You can join together in small groups and choose a topic for your DL project. You should prepare a poster and a spotlight talk (5 minutes) which you will present on the last course day. To get some hints how to create a good poster you can check out the links that are provided in poster_guidelines.pdf

If you need free GPU resources, we might want to follow the instructions how to use google colab. Help for preparing a hdf5 file from your images you can be found in the example Notebook.

Examples for projects from the DL course 2018 and 2019 can be found here from 2020

Fill in the Title and the Topic of your Projects until 30.03.2021 here

Other resources

We took inspiration (and sometimes slides / figures) from the following resources.

Dates

The course is split in 8 sessions, each 4 lectures long.

Day Date Time
1 23.02.2021 9:00-12:30
2 02.03.2021 9:00-12:30
3 09.03.2021 9:00-12:30
4 16.03.2021 9:00-12:30
5 23.03.2021 9:00-12:30
6 30.03.2021 9:00-12:30
7 06.04.2021 9:00-12:30
8 13.04.2021 9:00-12:30

Syllabus (might change during course)

Day Topic and Slides Additional Material Exercises and homework
1 Introduction, Fully Connected Networks, Keras slides Network Playground 01_simple_forward_pass colab
02_fcnn_with_banknote colab
2 Looking back at fcNN, working with loss curves, convolutional neural networks slides Understanding convolution 03_fcnn_mnist colab
04_fcnn_mnist_shuffled colab
05_cnn_edge_lover colab
06_cnn_mnist_shuffled colab
07_cifar10_norm colab
3 Tricks of the trade in CNNs slides Understanding CNNs 08_cifar10_tricks colab
08b_transferlearning colab
09_1DConv colab
4 Details: Backpropagation in DL, MaxLike-Principle slides 10_linreg_tensorflow colab
11_backpropagation colab
12_maxlike colab
12b_mnist_loglike colab
5 Probabilistic Models slides_part_1 slides_part_2 13_linreg_with_tfp colab
14_poisreg_with_tfp colab
6 Probabilistic models in the wild slides_part_1 slides_part_2
17_faces_regression colab
18_elephant_in_the_room colab
7 Bayesian Deep Learning slides_part_1 slides_part_2 20_cifar10_classification_mc_and_vi colab
8 Fun with Normalizing Flows slides_part_1 team projects fun with glow colab