-
### Suggestion Description
I just picked up a small computer with 5700G+64G RAM+1T drive for $400 to experiment with ROCm and plan to use it as a smart document assistance with some RAG programs. I a…
-
### Checked other resources
- [X] I added a very descriptive title to this issue.
- [X] I searched the LangChain documentation with the integrated search.
- [X] I used the GitHub search to find a sim…
-
Currently llamafiles are supported as generic OAI-compatible servers. While this works, it forces us to specify a valid (i.e. hf-transformers loadable) model name - which is needed for vLLM but might …
-
I’m new to using AutoTrain on Hugging Face and I encountered an issue during my first attempt at fine-tuning a model. I have a free account, because I want to see whether I can get something to work b…
-
### Issue description
Running same base prompt with dynamic text in it to analyze it, getting the error at 100
### Expected Behavior
I should received output in the format: "Answer: . Text: "…
-
I encountered an issue related to vLLM when I was trying to run Llama-3 70B PPO, this is likely due to the increased context length of the llama3 model. I was wondering if you guys have got this error…
-
### What happened?
The endpoint needs a /v1/ in the end according to this notebook: https://github.com/Azure/azureml-examples/blob/main/sdk/python/foundation-models/mistral/litellm.ipynb
I will up…
-
### Describe the bug
Apparently I cannot use Mistral models in a group chat setting. When a mistral model is set as the manager itself (using 'auto' speaker selection), it fails with the error `open…
-
Hi,
SentenceTransformers does not use the torch_dtype specified in the model config. New models like [e5-mistral-7b-instruct](https://huggingface.co/intfloat/e5-mistral-7b-instruct) are larger in s…
-
### Checked other resources
- [X] I added a very descriptive title to this issue.
- [X] I searched the LangChain.js documentation with the integrated search.
- [X] I used the GitHub search to find a …