Deep Learning

This one-week Deep Learning course covers theoretical and practical aspects, state-of-the-art deep learning architectures and application examples. The lectures will introduce to students the fundamental building blocks of deep learning methods and the weaknesses and strengths of the different architectures. Students will learn how to tailor a model for a particular application. During tutorials students practice the theory using exercises and have the opportunity to ask for additional explanation for those parts of the material perceived as more difficult. Computer lab sessions aim at making the material come alive and train students in how the methods learnt in class can actually be applied to data. The lab sessions are meant to work on the assignments, such that the students automatically keep up with the material.

Topics covered

• Introduction to Deep Learning (High-level definitions of fundamental concepts and first examples)
• Deep Learning components (gradient descent models, loss functions, avoiding over-fitting, introducing asymmetry)
• Feed forward neural networks
• Convolutional neural networks
• Embeddings (pre-trained embeddings, examples of pre-trained models, e.g., Word2Vec)
• Generative Adversarial Network (GAN)
• Advanced architectures (Densely connected networks, Adaptive structural learning)