-
[X] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug.
**Describe the bug**
I am unable to create test data set, using Ollama models , it…
-
While running this example:
```
$ cd TensorRT-Model-Optimizer/llm_ptq
$ scripts/huggingface_example.sh --type llama --model $model --quant fp8 --tp 2
```
there was a non-fatal failure:
```
[8ad0971d…
-
I want to use KoboldCpp or Ollama to provide translation services, believing that many LLM models can offer better results than existing online translation websites. What are the ways to achieve this?…
-
**Is your feature request related to a problem? Please describe.**
Solely supporting Pinecone is reportedly a deal breaker for some users, see for instance [this comment](https://news.ycombinator.com…
-
### Background / context
- was originally following install instructions for Mac at https://simonwillison.net/2023/Aug/1/llama-2-mac/ - yeah, I should have spotted that this was an older post....bu…
-
Create a new command to initialize Genval's AI's initial configurations:
The command would be executed as: `genvai genai init`
- Set the user LLM backend
- Set the API key for the selected LLM
- Set …
-
from paperqa import Settings, ask
import os
os.environ["OPENAI_API_KEY"] = "EMPTY"
local_llm_config = {
"model_list": [
{
"model_name": "ollama/llama3",
"litellm_params": {
"model": "ollama/ll…
-
**Describe the bug**
```
TypeError: Cannot assign to read only property '0' of string 'python ./plex_debrid/main.py'
at code (http://192.168.51.245:8083/assets/index-dc228d4a.js:204:14984)
…
-
Hi TensorRT-LLM team, Your work is incredible.
By following the READme file for [multi-modeling](https://github.com/NVIDIA/TensorRT-LLM/blob/main/examples/multimodal/README.md), we were sucess to run…
-
### Version
VisualStudio Code extension
### Operating System
Windows 11
### What happened?
When using Mac, Linux or Windows 11 with WSL2 Ubuntu, I get the following Bug.
Whenever a longer outp…