fix the option to support 'streaming=false' - Githubissues

young-geng / EasyLM

Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.

Apache License 2.0

2.33k stars 247 forks source link

fix the option to support 'streaming=false' #105

Open gystar opened 7 months ago

gystar commented 7 months ago

The original code can not support "streaming=false", resulting in the generated flax version of open_llama_7b can not be used in SecretFlow-SPU : OSError: Unable to convert /xxx/projects/open_llama_7b/flax_model.msgpack to Flax deserializable object