socketteer / loom

Multiversal tree writing interface for human-AI collaboration

1.02k stars 75 forks source link

Upgrade OpenAI API and add Together AI and llama.cpp as inference providers #26

Closed ksadov closed 2 months ago

ksadov commented 2 months ago

Changes

Upgraded openai pip package to 1.35.5
Added mac-requirements.txt file and Mac-specific install instructions to README
Added support for Together AI models
- added mistralai/Mistral-7B-v0.1 to model.py as default Together AI model
Added support for llama.cpp models and setup instructions to README
- Added llama-cpp-port-8009 to model.py as default llama.cpp model
Removed deprecated OpenAI models from model.py and components/modules.py

Notes

only tested on Mac so far, still needs Linux testing!