Open FFFiend opened 1 year ago
Latest comment here has some LLAMA-2 models that run on CPU: #417
@KrishPatel13 I can get some work done on this if work with your other PRs is getting in the way, just let me know 👍
@FFFiend Sure no worries! I can work on something else 😊.
https://github.com/facebookresearch/llama/issues/555 cant get LLama-2 to work inside a pipeline, not sure why.
Feature request
We basically want to see what model performs the best out of the box on generating action events given reference window state, ref actions and active window state, because we don't know what models we would like to add to
openadapt.ml_models.provider
other than GPT-3.5/4 for fine tuningRefer to #327 for a bare bones, simpler example of testing completions purely on GPT-3.5/4, and
stateful.py
for how event dicts are currently sanitized before being passed into the prompt.Also serves as a good exercise for using different ML API's (HuggingFace and OpenAI) and understanding how completions are made.
Motivation
Helpful for #379