search

volcengine / veScale

A PyTorch Native LLM Training Framework
http://vescale.xyz
Apache License 2.0
553 stars 26 forks source link

[Docker] Add patches for one-hot, expand_as, and etc ops #21

Closed jc-bytedance closed 4 months ago

jc-bytedance commented 4 months ago

In this PR, we update the dockerfile and image to include:

  1. support one hot op.
  2. support expand as.
  3. some minor updates.

As the result, it is highly recommended to install the patched PyTorch.