-
Model shows good performance for open source models.
- https://huggingface.co/openchat/openchat_3.5
- https://huggingface.co/mistralai
Mistral 22B could also be interesting but currently I suppo…
-
### Bug Description
Hi @ravi03071991,
I tried to download the Mixture-Of-Agents package but got the following error:
```
raise ValueError(f"Failed to find python package for class {llama_pack_cla…
-
First of all, thanks for the awesome component!
One issue I found: if I set `index=0` no option is selected by default. I expect the first option in the list to be selected by default. If I set any…
lotif updated
2 months ago
-
**Describe the bug**
When i tried to create API request using python it's give me an error on hugging chat GUI.
yesterday it was working well.
Error is : Sorry, something went wrong. Please try a…
-
**Describe the bug**
The fact that the script checks each time it calculates the impact whether a model exists for a specific provider leads to Ecologits frantically prints the following message: ‘Co…
-
I am trying to write a simple pdf agent which would answer questions on the basis of pdf knowledge
app.py
```
llm = Ollama(base_url = url,model=model,num_gpu=2)
rag_tool = PDFSearchTool(
p…
-
### Describe the issue as clearly as possible:
Regex generation with certain regex strings will produce strings that don't match the regex.
I have this regex string:
```
^(\[TOOL_CALLS\] \{\}|(…
aw632 updated
1 month ago
-
First of all, thanks for the great open source library!
The docs promise a few more additional metrics that I'm not seeing in vLLM 0.3.0, have these been removed? I.e. if I hit `/metrics` of the Op…
-
### Model introduction
The model is a new 12B foundation model trained by Mistral and NVIDIA with high performance on common non-coding benchmarks.
### Model URL
https://huggingface.co/mistralai/Mi…
-
### Your current environment
```text
The output of `python collect_env.py`
Collecting environment information...
PyTorch version: 2.3.0+cu121
Is debug build: False
CUDA used to build PyTorch…