-
Model: `TheBloke/Mistral-7B-OpenOrca-AWQ` (and any other Mistral AWQ model of them)
Cuda: `12.2`
```
WARNING 12-03 17:13:44 config.py:398] Casting torch.bfloat16 to torch.float16.
WARNING 12-03 …
-
model:Llama2-Chinese-7b-Chat
GPU:RTX4090
the generation speed of the original model:47.36 token/s
the generation speed of the pruned model:30.49 token/s
with all the generate parameters is same
…
-
Hello,
Great work, thank you! To reiterate:
## Machine Details
* M1 Pro, 16gb
* MacOS Sonoma
* Python 3.11
### Steps to Reproduce
1.`git clone https://github.com/imartinez/privateGPT`…
-
**Proposed Rule Name:** PoorIdentifierName
**Proposed Category:** Best Practices
**Description:**
As a human, coming up with meaningful identifier names is sometimes hard. I have to spend up…
-
I understand this modpack has 440 mods about and crashing is prone to happen, however its been happening much more frequently, the crash report is below and please let me know how to fix this. Thank y…
-
### Operating System
Windows 10
### Java Runtime
Java
### Java Version
21
### Release Version
4.3.2
### Issue
The list contains 29 anime in 'On-Hold' state.
![image](https://github.com/Kat…
-
### Describe the problem you are having
I am running frigate 0.12.1 in a privileged proxmox lxc container where I am running docker with portainer.
At first I had a mini pcie coral which worked fi…
-
-
![360maps](https://github.com/user-attachments/assets/c12bf5f0-9298-400e-8b7e-923959730ef5)
-
As the title suggests.
I try to make my own Dockerfile, but it always fails to build.
https://github.com/moeru-ai/Moeru-Llama-3-8B/blob/main/Dockerfile
(It would be great to have IPEX-LLM + o…
kwaa updated
3 months ago