alpa-projects / alpa

Training and serving large-scale neural networks with auto parallelization.
https://alpa.ai
Apache License 2.0
3.07k stars 357 forks source link

Question concerning training #930

Open nferreira opened 1 year ago

nferreira commented 1 year ago

Is there a documentation page or tutorial on how to train NLP model-based Facebook OPT, for instance, to include more knowledge, e.g. context-specific knowledge and text?