Schedule
The schedule is subject to change. Check back often. Notes/codes/slides links are placeholders for future lectures. They will be updated no later than the lecture date.
-
EventDateDescriptionCourse Material
-
Lecture01/21/2025
Tuesday01 - Intro to Deep Learning and Course LogisticsSuggested Readings:
- UDL Chapter 1
-
Lecture01/23/2025
Thursday02 - Supervised LearningSuggested Readings:
- UDL Chapter 2
-
Discussion01/24/2025
FridayDiscussion_01 - SCC and Environment Setup[slides]Notebook: 00_fundamentals.ipynb
Suggested Readings: -
Lecture01/28/2025
Tuesday03 - Shallow NetworksSuggested Readings:
- UDL Chapter 3
-
Assignment01/29/2025
WednesdayProject Proposal released! -
Lecture01/30/2025
Thursday04 - Deep NetworksSuggested Readings:
- UDL Chapter 4
-
Discussion01/30/2025
ThursdayDiscussion_02 - SCC Part 2 + Common Practices in Structuring DL Code + Examples to try out qsub and qrshSuggested Readings:
-
Lecture02/04/2025
Tuesday05 - Loss FunctionsSuggested Readings:
- UDL Chapter 5
-
Lecture02/06/2025
Thursday05a - Loss Functions, ContinuedSuggested Readings:
- UDL Chapter 5
-
Discussion02/07/2025
FridayDiscussion_03 - Loss Functions, Activation Functions, Basic PyTorch components for building a model[Notebook] -
Lecture02/11/2025
Tuesday06 - Fitting ModelsSuggested Readings:
- UDL Chapter 6
-
Lecture02/13/2025
Thursday07 - Gradients and BackpropagationSuggested Readings:
- UDL Sections 7.1 - 7.4
-
Discussion02/14/2025
FridayDiscussion_04 - Autograd and Automatic Differentiation in PyTorch[Notebook] -
Due02/16/2025 23:59
SundayProject Proposal Due -
No Class02/18/2025 20:30
TuesdaySubstitute Monday schedule -
Lecture02/20/2025
Thursday08 - Initialization[slides]Suggested Readings:
- UDL Sections 7.5 - 7.6
-
Discussion02/21/2025
FridayDiscussion_05 - Weight Initialization, Data Loader, and Training Loop[Notebook] -
Lecture02/25/2025
Tuesday09 - Measuring PerformanceSuggested Readings:
- UDL Chapter 8
-
Lecture02/27/2025
Thursday10 - RegularizationSuggested Readings:
- UDL Chapter 9
-
Discussion02/28/2025
FridayDiscussion_05 - Regularization[Notebook] -
Lecture03/04/2025
Tuesday11 - Convolutional Neural NetworksSuggested Readings:
- UDL Chapter 10
-
Lecture03/06/2025
Thursday12 - Residual Networks[slides]Suggested Readings:
- UDL Chapter 11
-
Session Ends03/07/2025 20:30
FridayFirst 7 week session ends -
Start of Spring Recess03/08/2025 20:30
SaturdaySpring recess begins -- Have a great break! -
End of Spring Recess03/16/2025 20:30
SundaySpring recess ends -
Session Begins03/17/2025 20:30
Monday2nd 7 week session begins -
Lecture03/18/2025
Tuesday13 - Recurrent Neural Networks[slides]Suggested Readings:
-
Lecture03/20/2025
Thursday14 - Transformers Part 1[slides]Suggested Readings:
- UDL Chapter 12
- Optional: The Illustrated Transformer
-
Lecture03/25/2025
Tuesday15 - Transformers Part 2[slides]Suggested Readings:
- UDL Chapter 12
- Optional The Illustrated Transformer
-
Lecture03/25/2025
Tuesday16 -- Vision & Multimodal Transformers[slides]Suggested Readings:
- See slides for references
-
Lecture03/27/2025
Thursday17 -- Improving LLM Perf[slides]Suggested Readings:
- See slides for references
-
Lecture04/01/2025
Tuesday18 - Parameter Efficient Fine Tuning[slides]Suggested Readings: References are in the lecture slides.
-
Lecture04/03/2025
Thursday19 -- Unsupervised Learning and GANs[slides]Suggested Readings:
- UDL Chapters 14 and 15
-
Lecture04/08/2025
Tuesday20 - Variational Autoencoders (VAEs)[slides]Suggested Readings:
- Understanding Variational Autoencoders
- UDL Chapter 17 (optional)
-
Lecture04/10/2025
Thursday21 -- Diffusion Models[slides]Suggested Readings:
- Rocca, Understanding Diffusion Probabilistic Models
- UDL Chapter 18
-
Lecture04/15/2025
Tuesday22 -- Graph Neural Networks[slides]Suggested Readings:
- UDL Chapter 13
-
Lecture04/17/2025
Thursday23 - Reinforcement Learning[slides]Suggested Readings:
- UDL Chapter 19
-
Lecture04/22/2025
Tuesday24 - TBDSuggested Readings:
- TBD
-
Lecture04/24/2025
Thursday25 - TBDSuggested Readings:
- TBD
-
Due04/29/2025 20:30
TuesdayProject Presentations Round 1 -
Due05/01/2025 20:30
ThursdayProject Presentations Round 2