-
Using the instructions here: https://github.com/ray-project/ray-llm#how-do-i-deploy-multiple-models-at-once I'm trying to host two models on a single A100 80G.
Two bundles are generated for the pla…
-
It's very frustrating that a lot of messages get written to stderr, like model parameters that are very difficult to differentiate from errors. I tried to capture stderr but then also error messages g…
-
Hi, I'm a reader of the work "Instruction Pre-Training: Language Models are Supervised Multitask Learners."
Currently, I'm trying to replicate the results of vanilla continual pre-training on Llama3…
-
### Please check that this issue hasn't been reported before.
- [X] I searched previous [Bug Reports](https://github.com/OpenAccess-AI-Collective/axolotl/labels/bug) didn't find any similar reports…
-
I'd love to use ctransformers with the [outlines](https://github.com/normal-computing/outlines) library for constrained generation. I opened this [issue ](https://github.com/normal-computing/outlines/…
-
### Describe the issue
I am trying to combine the following two notebooks into one:
1. [Agent Chat with custom model loading](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_cust…
-
I get a leading space in the answer from some models, e.g. `mistral` and `mistral-openorca`. This also happens in the terminal:
```
$ ollama run mistral-openorca "hi"
Hello! How can I help you t…
-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [x] I am running the latest code. Development is very rapid so there are no tagged versions as of…
-
While I pulled already llama2:7b , I wanted to install llama2 (without the 7b tag). My understanding was that it was the same exact model (same hash), so maybe ollama would install only the metadata f…
-
Rudolf přidal na Zotero nějaké další poetry papers z loňského ICCC:
https://www.zotero.org/groups/5184983/poetrygeneration/items/AR7KTGPK
- On the power of special-purpose GPT models to create and e…