facebookresearch / metaseq

Repo for external large-scale work
MIT License
6.45k stars 723 forks source link

Unify all the language_modeling tasks #582

Open suchenzang opened 1 year ago

suchenzang commented 1 year ago

Right now, we have:

We should remove all but one of these to simplify the codebase.

suchenzang commented 1 year ago

language_modeling_inference_for_models_trained_with_streaming can be removed! wooohoo