Transfer Learning Methods

[Oufattole]

We can add additional classes that inherit the supervised model class For now the implementation will be Triplet tokenizaiton specific, but we should generalize it in the future. These are the methods:

• [x] #18
• [ ] Masked Imputation
• [x] Value Forecasting (in a predetermined window)
• [x] Autoregressive Forecasting

[mmcdermott]

This is very interesting, but most challenging and potentially has more dependencies than other experimental questions (in other ways it is more independent as it is just a question of what you do with your output embeddings).

In particular, dependencies on

1. Dataset size and makeup
2. hyperparameter tuning
3. Richness of input encoding
4. Computational resources

All make this potentially more challenging (and certainly more expensive) to explore -- that all being said, this is likely one of the highest impact questions that is "purely" about the learning process.