Autoparallel / learner

Making learning sh*t less annoying
https://crates.io/crates/learner
10 stars 0 forks source link

feat(`learner`): add chunking to long requests to llama #58

Open Autoparallel opened 6 days ago

Autoparallel commented 6 days ago

If we have a request that exceeds the context length of the model, we should chunk this nicely so that it can still work with the whole piece of text.