Self-supervised learning

- 5 mins

My notes from “Self-Supervised Learning” talk by Yann LeCun at PAISS 2019.

ConvNets

Self-supervised learning

Energy based learning

  1. Build the machine so that the volume of low energy stuff is constant.
    • PCA energy function (not a good representation of the data manifold)
\[F(Y) = {|| W^TWY - Y^2 ||}^2\] \[F(Y) = min_{x} \sum_i {||Y - W_i Z_i ||^2 }\]

Latent Variable Models

Variational Auto-Encoder

comments powered by Disqus
rss facebook twitter github youtube mail spotify lastfm instagram linkedin google google-plus pinterest medium vimeo stackoverflow reddit quora quora