Updates the toml script to the release tag version; Removes the poetry related config from the toml script; Updates the engine to take checkpoint paths without .safetensors suffix for better user experience.

google / jetstream-pytorch

PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"

Apache License 2.0

33 stars 14 forks source link

Updates the toml script to the release tag version; Removes the poetry related config from the toml script; Updates the engine to take checkpoint paths without .safetensors suffix for better user experience. #10

Closed wang2yn84 closed 5 months ago

wang2yn84 commented 5 months ago

Updates the toml script to the release tag version
Removes the poetry related config from the toml script
Updates the engine to take checkpoint paths without .safetensors suffix for better user experience.

FanhaiLu1 commented 5 months ago

Can you also update the user guide doc: https://docs.google.com/document/d/1jOzQGZb66VyD1awtW0Vm71BGKGxpUPwIYbX-KVLKOCs/edit?resourcekey=0-LczW5SyjGFCsqaA8o3dr0g&tab=t.0#heading=h.g0e8mz3tgjwb

wang2yn84 commented 5 months ago

For 70B, how many safetensors file?

Same thing, there will be 1 safetensors file.

wang2yn84 commented 5 months ago

Can you also update the user guide doc: https://docs.google.com/document/d/1jOzQGZb66VyD1awtW0Vm71BGKGxpUPwIYbX-KVLKOCs/edit?resourcekey=0-LczW5SyjGFCsqaA8o3dr0g&tab=t.0#heading=h.g0e8mz3tgjwb

Sure, will be after merged to main.

wang2yn84 commented 5 months ago

Chatted offline and decided to not update the user guide since JetStream and MaxText are all released with 0.2.0 and let's stick to that for the NEXT release.