Code Monkey home page Code Monkey logo

info8010-deep-learning's Introduction

INFO8010 - Deep Learning

Lectures for INFO8010 - Deep Learning, ULiège, Spring 2023.

  • Instructor: Gilles Louppe
  • Teaching assistants: Arnaud Delaunoy, François Rozet, Yann Claes, Victor Dachet
  • When: Spring 2023, Friday 8:30 AM
  • Classroom: R3 / B28

Agenda

Date Topic
February 10 Course syllabus [PDF] [video]
Lecture 0: Introduction [PDF] [video]
Lecture 1: Fundamentals of machine learning [PDF] [video]
February 17 Lecture 2: Multi-layer perceptron [PDF] [video] [code 1, code 2]
February 24 Lecture 3: Automatic differentiation [PDF] [video] [code]
March 3 Lecture 4: Training neural networks [PDF] [video]
March 6 Deadline for Homework 1
March 10 Lecture 5: Convolutional neural networks [PDF] [video] [code]
March 17 Lecture 6: Computer vision [PDF] [video]
March 20 Deadline for Homework 2
March 20 Deadline for the project proposal
March 24 Lecture 7: Attention and transformers [PDF] [video]
March 31 Lecture 8: GPT [PDF] [code]
April 21 Lecture 9: Graph neural networks [PDF]
April 28 Lecture 10: Uncertainty [PDF] [video]
Tutorial: Weight and Biases (Thomas Capelle, ML engineer at wandb.ai)
May 5 Lecture 11: Auto-encoders and variational auto-encoders [PDF] [video] [code]
May 12 Lecture 12: Diffusion models [PDF]
May 19 Deadline for the reading assignment
May 19 Deadline for the project

Homeworks

The goal of these two assignments is to get you familiar with the PyTorch library. You can find the installation instructions in the Homeworks folder. Each homework should be done in groups of 2 or 3 (the same as for the project) and must be submitted before 23:59 on the due date. Homeworks should be submitted on Gradescope.

  • Homework 1: Tensor operations, autograd and nn. Due by March 6, 2023.
  • Homework 2: Dataset, Dataloader, running on GPU, training a convolutional neural network. Due by March 20, 2023.

Homeworks are optional. If submitted, each homework will account for 5% of the final grade.

Project

See instructions in project.md.

Reading assignment

Your task is to read and summarize a major scientific paper in the field of deep learning. You are free to select one among the following three papers:

  • Rombach et al, "High-Resolution Image Synthesis with Latent Diffusion Models", 2022. [Paper]
  • Chen et al, "Evaluating Large Language Models Trained on Code", 2021 [Paper]
  • Jumper et al, "Highly accurate protein structure prediction with AlphaFold", 2021. [Paper]

You should produce a report that summarizes the problem that is tackled by the paper and explains why it is challenging or important, from the perspective of the wider research context. The report should outline the main contributions and results with respect to the problem that is addressed. It should also include a critical discussion of the advantages and shortcomings of the contributions of the paper. Further guidelines for writing a good summary can be found here (Section 2, "The summary").

Constraints:

  • You can work in groups of maximum 3 students (the same as for the project).
  • You report must be written in English.
  • 2 pages (excluding references, if any).
  • Formatted using the LaTeX template template-report.tex.

Your report should be submitted by May 19 on Gradescope. This is a hard deadline.

Archives

Previous editions

Archived lectures

Due to progress in the field, some of the lectures have become less relevant. However, they are still available for those who are interested.

Topic
Recurrent neural networks [PDF] [video]
Generative adversarial networks [PDF] [video]

info8010-deep-learning's People

Contributors

glouppe avatar paintception avatar awehenkel avatar francois-rozet avatar adelau avatar lgaspard avatar yannclaes avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.