search

intel / xFasterTransformer

Apache License 2.0
374 stars 65 forks source link

[Example] Add llama2 chat support in Cli demo. #243

Closed Duyi-Wang closed 8 months ago

Duyi-Wang commented 8 months ago

Add llama 2 Chat mode support. Demo will skip prompt when --chat true.