Llama3 web_demo code is too old and output without end

sophgo / LLM-TPU

Run generative AI models in sophgo BM1684X

103 stars 16 forks source link

Llama3 web_demo code is too old and output without end #21

Closed zifeng-radxa closed 3 months ago

zifeng-radxa commented 3 months ago

when i try to use web_demo in Llama3, i found if use the gradio 3.39.0 in requirements.txt, it output error

AttributeError: 'Textbox' object has no attribute 'style'

after i remove style in Textbox it can run success, but the llama3 output without end until the input size large then maixmum length, so weirddddddddd