search

volcengine / veScale

A PyTorch Native LLM Training Framework
http://vescale.xyz
Apache License 2.0
553 stars 26 forks source link

Code Example & Docs #14

Closed ultranity closed 4 months ago

ultranity commented 5 months ago

Great work~ When will we have some example code and API docs available for veScale/MegaScale?

liwenchangbdbz commented 5 months ago

An open Llama example with checkpointing will be provided this week (scheduled on 3/27), and another GPT example is tentatively scheduled on 4/2. Stay tuned. :)

liwenchangbdbz commented 5 months ago

We swapped the release dates of the two examples.