-
Hey Guys,
I've got an exception when I run Skyvern with docker images on a Ubuntu server.
There's a proxy on the server which helps me to access the internet. I'm not sure if it's related to this …
-
I am trying to use paper-qa with a locally-hosted model. However, the provided example:
```python
from paperqa import Settings, ask
local_llm_config = dict(
model_list=[
dict(
…
-
### Your current environment
### Model Input Dumps
_No response_
### 🐛 Describe the bug
```text
The channel dimension is ambiguous. Got image shape (1, 1, 3). Assuming channels are the firs…
-
* I am following the example of BART LoRA at [here](https://github.com/NVIDIA/TensorRT-LLM/tree/main/examples/enc_dec#run-bart-with-lora). I cannot convert the engines without flag `--context_fmha dis…
-
### Description
Having problems getting a agent manage to work.
Using the `crewai create crew` command to setup a project.
Which uses different syntax than all the documentations, which is a bi…
-
I want to use KoboldCpp or Ollama to provide translation services, believing that many LLM models can offer better results than existing online translation websites. What are the ways to achieve this?…
-
### System Info / 系統信息
cuda 12.2，centos7
### Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece？
- [X] docker / docker
- [ ] pip install / 通过 pip install 安装
- [ ] installation from source …
-
Hey guys,
Thanks for making your work public. I'm wondering if you have or will be exploring LLMs other than GPT4 for your evaluations. For instance, you've used Llama 3 in your benchmarks, would y…
-
Hi Kaicheng,
Thank you, this is super helpful! Considering data privacy issues and the emergence of really powerful small models I think a tutorial for using local LLMs would be very useful. I've e…
-
Hello, thanks a lot for developing this project. It seems very useful for using TensorRT-LLM.
I have bumped into CUDA issues when I was trying to use your prebuilt container with your README, but cou…