Basics of Training and Optimizing Neural Networks

January 24, 2023 - 2 minute read - Category: Intro - Tags: Deep learning


This post covers the seventh lecture in the course: “Basics of Optimizing Neural Networks; Classification.”

This is a kitchen sink lecture about optimizing neural nets. The Goodfellow, Bengio and Courville textbook is a very helpful reference. Here are some additional references that provide very useful insights:

Lecture Video

Watch the video

Lecture notes

References Cited in Lecture 7: Basics of Optimizing Neural Networks; classification


Batch Normalization

Other Refinements

Hyperparameter Tuning

Other Resources

Image Source: