search

huggingface / nanotron

Minimalistic large language model 3D-parallelism training
Apache License 2.0
1.14k stars 107 forks source link

Question: Roadmap / Feature Scope #30

Closed Algomancer closed 8 months ago

Algomancer commented 8 months ago

This is awesome,

What type of stuff would you guys consider in scope for upstream? Might use this in a new project.

NouamaneTazi commented 8 months ago

Added in this section https://github.com/huggingface/nanotron?tab=readme-ov-file#development-guidelines