-
## Context
As an open-source advocate, I would like to demonstrate **Coverlettergpt** using alternative LLMs models provided as instance on HuggingFace.co
## Solution
Add the possibility to switc…
-
In the example a document is uploaded and the model is asked to name the planets in the solar system - this is a task any decent LLM should be able to do without a document. Currently when I open a pd…
-
thanks for sharing this great UI! : )
Is it possible to run Falcon?
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
-
![image](https://github.com/NVIDIA/TensorRT-LLM/assets/99886928/8e943648-01b0-4315-b7d6-f7a553b3f9cf)
i clone the latest of main branch, and build it successful, but it is too large, 357GB
-
### System Info
### System Info
* CPU Architecture - x86_64
* CPU/Host memory size - 330gb from `/proc/meminfo`
* GPU name - NVIDIA H100 80GB HBM3
* GPU memory size - 81559MiB
* TensorRT-LLM…
-
**Is your feature request related to a problem? Please describe.**
At times, the scripts generated by the Language Model (LLM) may contain errors, necessitating developers to conduct debugging and te…
-
### Proposal to improve performance
We used the same GPU on two machines but different CPUs. The following experimental conclusions were drawn:
Experimental results: The GPU is 3090, and the CPU w…
-
### Describe the bug
With LangGraph and Anthropic, time to first token shows full generation time
### To reproduce
```python
from typing import Annotated
import time
from langchain_anthropic …
-
https://huggingface.co/mattshumer/Reflection-70B
https://x.com/mattshumer_/status/1831767014341538166
-
I found https://litellm.ai/
it seems like an easy integration for even more open-source LLMs.
What do you think?