arcee-ai / DAM

30 stars 4 forks source link

Option to record ALL loss metrics, independent of usage #40

Closed ElliotStein closed 1 week ago

ElliotStein commented 2 weeks ago

Add command line control over whether all loss function components are computed and reported to WandB, independently of whether they are used in the loss function.

Useful for comparing off-target/correlated effects of loss components.

Set to false by default as doing so will add computation time.