-
Hey, I have a machine with two 4090 GPUs (24 GB VRAM each). When I try to run HQQ quantization of Llama-2-70B:
```
from hqq.engine.hf import HQQModelForCausalLM, AutoTokenizer
#Model and settti…
-
### System Info
We can load models in 4-bit with and without bitsandbytes support.
so what is the major difference between both?
1)
```
from transformers import AutoModelForCausalLM
AutoModelF…
-
https://huggingface.co/internlm/internlm-xcomposer2-7b-4bit
run the code in readme, find the following issues:
1. quant_model is not initialized.
2. auto_gptq.modeling do not have BaseGPTQForCau…
-
**Is your feature request related to a problem? Please describe.**
I am writing a helm chart to deploy this image.
I was previously using https://github.com/rylorin/ib-gateway-docker but would pref…
-
I use `A10 GPU` with `AutoAWQ 0.2.2`, and the model is `deepseek-7B`。
The command is:
```
from awq import AutoAWQForCausalLM
from transformers import AutoTokenizer
model_path = '/data/deepsee…
-
hello.
firstly, it was hard to find Adafruit library for dht library in arduino ide, so to fix it:
**Adafruit_Unified_Sensor should be installed in arduino ide library manager**
secondly, i spent…
-
Bonjour,
Je souhaite rajouter la couche cartographique des points d'eau de mon département.
J'ai récupéré le lien du flux WMS des points DECI mais rien ne s'affiche.
Le flux est au format 2154 se…
-
This is a tracking issue for our effort to enable pylint on all Python testing code underneath `tests/python`. Currently we don't lint scripts in that directory. We're going to take an incremental app…
-
# Batch control functionality overview
This documentation will be a "phase 1" which should not require extensive modification of the code base.
## Expected functionality
### Stock module
#…
-
# 平台(如果交叉编译请再附上交叉编译目标平台):
# Platform(Include target platform as well if cross-compiling):
aarch64-linux
Device name is: QUALCOMM Adreno(TM)
Vendor: QUALCOMM
Driver version: OpenCL 3.0 QU…