Understanding MDL calculations

[diogo-cruz]

This involves:

• Understanding how the MDL is being computed in both the toy and LLM tasks, in Lovering.
• Understanding why our toy MDL values differ from the ones in the Lovering paper.
• Understanding what changes need to be made to compute the MDL for the sentiment/summarization LLM+RL tasks.
• (Optional) Understanding how the AUC metric is computed.

[diogo-cruz]

As a subtask:

• Implement MDL without AUC calculations
• Reduce number of epochs
• Reduce number of examples used