Contrastive Learning

February 23, 2023 - 2 minute read - Category: Intro - Tags: Deep learning


This post covers the eigth lecture in the course: “Contrastive Learning.”

Contrastive learning has revolutionized deep learning and many of the applications covered later in this course will use it. This lecture covers contrastive loss, its potential problems, and what makes it work.

Lecture Video

Watch the video

Lecture notes

References Cited in Lecture 8: Contrastive Learning

Contrastive Loss

Varities of Contrastive Learning

Siamese Representation Learning

Chen, Xinlei, and Kaiming He. “Exploring simple siamese representation learning.” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 15750-15758. 2021.

Other Resources

  • Contrastive Representation Learning:

Image Source: