epfLLM / Megatron-LLM

distributed trainer for LLMs
Other
529 stars 76 forks source link

Better documentation #57

Closed AleHD closed 1 year ago

AleHD commented 1 year ago

This PR improves the documentation and overall structure of the weight conversion utilities available. Main features:

AleHD commented 1 year ago

Note that some of the features mentioned (namely, instruction tuning and metrics support) are not merged yet (PR #40 and #55, respectively).