search

openppl-public / ppl.llm.serving

Apache License 2.0
122 stars 13 forks source link

test #38

Closed ouonline closed 9 months ago

ouonline commented 9 months ago

What are the problems?(screenshots or detailed error messages)

What are the types of GPU/CPU you are using?

What's the operating system ppl.llm.serving runs on?

What's the compiler and its version?

Which version(commit id or tag) of ppl.llm.serving is used?

What are the commands used to build ppl.llm.serving?

What are the execution commands?

minimal code snippets for reproducing these problems(if necessary)

models and inputs for reproducing these problems (send them to openppl.ai@hotmail.com if necessary)