-
Update the JSON with cost for models in TogetherAI in [callback_handler.py](https://github.com/neokd/NeoGPT/blob/main/neogpt/callback_handler.py) and add a flag called `--max-budget` in the main.py.
neokd updated
9 months ago
-
I pulled the 8-bit quant overnight using `ollama pull codellama:70b-instruct-q8_0` and seem to be having problems with it.
I've tried the default Ollama modelfile and also what I think is the corre…
-
We've gotten a lot of requests for adding integrations with open source language models like Wizard Coder, Phind's Code Llama and others.
We want you to know this is one of our top priorities right…
-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [x] I am running the latest code. Development is very rapid so there are no tagged versions as of…
-
### Description
When trying to set up local models, I will run into what appears to be an unrecoverable problem. This happens both working on a linux box that has a NVIDIA card and on my M1 Mac. In b…