fix issue 53 & 54 - Githubissues

intel-analytics / ipex-llm-tutorial

Accelerate LLM with low-bit (FP4 / INT4 / FP8 / INT8) optimizations using ipex-llm

https://github.com/intel-analytics/bigdl

Apache License 2.0

142 stars 37 forks source link

fix issue 53 & 54 #58

Closed Ariadne330 closed 10 months ago

Ariadne330 commented 11 months ago

Fix some issues

[Issue #53](https://github.com/intel-analytics/bigdl-llm-tutorial/issues/53) Delete all the lines about time print.
[Issue # 54](https://github.com/intel-analytics/bigdl-llm-tutorial/issues/54) Change max_new_tokens number to 32 for non-stream tasks.