-
Started happening sometime in the last week.
-
### Feature request
The peft support for Llama models is already present for Causal LM. It would be good to have support it for Sequence Classification as the modeling file of Llama in HuggingFace ha…
-
### System Info
[What I used]
1. Polyglot-12.8b(GPT-Neox based, https://huggingface.co/EleutherAI/polyglot-ko-12.8b)
2. transformer version: 4.32.0.dev0
3. trainer: transformers run_clm_no_trainer…
-
### System Info
When running on Kubernetes using the latest image and attempting to run through the tutorial with bloom-560m, it looks like PyTorch is unable to detect the GPU.
### Information
- [X…
-
Hi, I'm wondering if I could use peft to finetune 176B BLOOMZ?
I am experiencing poor GPU utilization efficiency with 64 V100s.
-
I am wondering why the calculation time has big difference between as of 2019 and as of 2023.
Could you tell me why this big difference happens? algorithms is different?
I have used profiling tool …
-
Request from Mike Konrad--not absolutely sure this can be done but should at least think about it and do it if it's feasible.
-
# Module: AI-900
## Lab/Demo: 02b - Explore classification with Azure Machine Learning Designer
### Task: Add transformations
#### Step: 2
Description of issue:
The pipeline does not contain …
-
I am facing gpu increasing until OOM
run command
```bash
accelerate launch --config_file ds_zero3_cpu_fp16.yaml run_clm_no_trainer_lora.py --model_name_or_path "gpt2" --dataset_name="w…
-
Can I just check this is intended behavior? I was expecting the `weights` value to include / apply the sampling weights as those are printed in the summary method. Example to illustrate what I mean:
…