search

zomux / lanmt-ebm

lanmt ebm
11 stars 1 forks source link

A summarization of all losses #8

Open zomux opened 4 years ago

zomux commented 4 years ago

A summarization or loss.pdf

zomux commented 4 years ago

Screen Shot 2020-03-09 at 9 52 02 PM Screen Shot 2020-03-09 at 9 52 08 PM

zomux commented 4 years ago

Coding

zomux commented 4 years ago

Denoising Losses

zomux commented 4 years ago

Denoising is not predicting prefect tokens in the continuous space

zomux commented 4 years ago

Potential problem of continuous space: difference between two tokens are not really continuous

A discrete distribution might model the relationship much better