search

antimatter15 / alpaca.cpp

Locally run an Instruction-Tuned Chat-Style LLM
MIT License
10.25k stars 910 forks source link

Max Sequence Length #207

Closed vrunm closed 1 year ago

vrunm commented 1 year ago

How to change the max sequence length of the model? I am using it for generating outputs of more than 20 lines. Also I am providing an instruction prompt and query text to the model for inference.

openMolNike commented 1 year ago

max input is 256 symbols now. Next symbols will be ignored =(