-
python : 3.7
cuda : 11.1
pytorch : 1.8
I am trying to compile the cuda code which does not work, could you have a look please? thanks
```
Traceback (most recent call last):
File "jit.py"…
-
Hello!
I propose to add support for the Erebus family of models, these are finetune models of the original OPT. I looked at the code, and the support is not too difficult to add, and I was able to ru…
-
cuda: 35tokens/s
triton: 5tokens/s
I used ooba's webui only for cuda, because I've been unable to get triton to work with ooba's webui, I made sure i used the same parameters as in the command for…
-
I've added the stop token but it does not work?
-
Hi there, I'm running into an issue when I try to run this extension in an instance of Textgen Web UI that is itself inside docker.
```
text-generation-webui-text-generation-webui-1 | 19:53:51-42…
-
### System Info
jetson-agix-orin
### Who can help?
_No response_
### Information
- [ ] The official example scripts
- [ ] My own modified scripts
### Tasks
- [ ] An officially supported task …
-
Hello, I have been running oobabot on a private server for a bit now. My typical setup is a 13b parameter ggml file split across cpu and gpu. when it works, everything is fantastic. However quite ofte…
-
Greetings Faris ,
mid there a way to bypass the authentication process for GitHub Copilot, because the plug-in that is in vscode is not fully offline , but needs authentication in order to make you…
-
![image](https://github.com/turboderp/exui/assets/28905253/f0ef8040-9dd9-4b76-86c0-64f203cd2f72)
I was able to clone, but installing from requirements fails. How do I get around this?
_For refer…
-
# Trending repositories for C#
1. [**2dust / v2rayN**](https://github.com/2dust/v2rayN)
__A GUI client for Windows, support Xray core and v2fly core and others__
48 stars…