Loss function for Pre-training

cnellington / Contextualized

An SKLearn-style toolbox for estimating and analyzing models, distributions, and functions with context-specific parameters.

http://contextualized.ml/

GNU General Public License v3.0

65 stars 9 forks source link

Open blengerich opened 2 years ago

blengerich commented 2 years ago

It would be nice to have a loss function for pretraining which takes in prior knowledge of correlated/uncorrelated/anti-correlated pairs.