namoray / nineteen

nineteen
11 stars 24 forks source link

Feature/hotfix prompt length #119

Open MahdiPresario001 opened 1 week ago

MahdiPresario001 commented 1 week ago

Add n_output_tokens into the condition: n_prompt_tokens + n_output_tokens < max_model_len