Open jackboyla opened 4 months ago
Note multiple heads can be trained for sub-objectives, for example just for the prompt representation https://github.com/jackboyla/GLiREL/blob/main/glirel/model.py#L64-L70 and encoding a prior probability that the trained model will succeed at predicting a given zero-shot relation
Goal: At some point during training, we wish to introduce an additional confidence head, which will output model confidence that a given prediction is correct.
current loss computation https://github.com/jackboyla/GLiREL/blob/main/glirel/model.py#L242-L259 backprop: https://github.com/jackboyla/GLiREL/blob/main/glirel/model.py#L242-L259