-
My model is
```json
{
"mlp_bias": false,
"attn_bias": false,
"rotary_base": 300000,
"rotary_scaling": null,
"residual_mlp": false,
"disable_weight_only_quant_plugin": false,
…
-
Firstly, I saved finetuned LORA model as merged_16bit on my huggingface repo. And i have adapter_config.json and adapter_model.safetensor inside my repo. Now when trying to load with AutoAWQForCausalL…
-
### System Info
```
pip install git+https://github.com/huggingface/transformers.git
pip install tokenizers==0.20.0
pip install accelerate==0.34.2
pip install git+https://github.com/huggingface/tr…
-
I wanted to share the following programs, which I investigated for run times.
These are the verification times:
data/quant_s1.pvl 8.662854194641113 success
data/quant_s2.pvl 7.364089488983154 suc…
-
My use case and GPU:
model: Qwen2-72B-Instruct
max_token_len (input+output): 20000
gpus: 4xA100
when I use code from https://github.com/casper-hansen/AutoAWQ/blob/main/docs/example…
-
Hi,
I got the following error message from kallisto quant, but kallisto seems to be on version 0.50.0 and it doesn't explain what those versions refer to.
```
[quant] fragment length distributio…
-
Hi,
Thank you for developing this tool for evaluating L1 expression. I'm encountering an issue while running L1EM from a conda environment. Here is my setup and the steps I followed:
**Environme…
-
### System Info
Latest TRL from source, can't run TRL env rn as cluster is shut down but I'm installing everything from source.
If required will restart cluster and run.
### Information
- [ ] Th…
-
Hi,
I am currently trying to run Taiji on a set of WT and KO RNAseq and ATACseq data. To not mess with previous analyses I decided to use the already existing gene quantification, which I did with …
-
hello. I am getting an error when running the sample below.
The request file does not exist in the original source,
I copied and used the preprocessor_config.json file in the same model family.
…