search

h-alice / llamacpp-webui

A StreamLit WebUI for LLaMA.cpp.
MIT License
3 stars 0 forks source link

Increase the token size of llama-cpp. #3

Closed h-alice closed 5 months ago

h-alice commented 5 months ago

Sometimes we suffer from truncated output from model. It seems the maximum output tokens blocks the model from generates full outputs.

NatLee commented 5 months ago

uwu