-
### Your current environment
Collecting environment information...
PyTorch version: 2.3.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
OS: Debia…
-
PC Hardware:
- i7-9700kf
- Nvidia gtx 1660(6Gb)
- 16Gb memory
model used:
- TheBloke/wizardLM-7B-GPTQ
- wizardLM-7B-GPTQ-4bit-128g.no-act.order.safetensors
env:
Running in windows10 WSL2…
-
I get this error when running '!python agent.py --config config.yaml'
/content/muzic/musicagent
2023-12-04 10:03:54.786370: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow bin…
-
### System Info
transformers version -> 4.33
python version -> 3.10.6
I try to finetune this huggingface model : NousResearch/Llama-2-70b-chat-hf
With this huggingface dataset : mlabonne/gua…
-
Hi, I am training the LLaMa3 using the SFTtrainer to fit only one data point. The training arguments are shown below:
`base_model = "meta-llama/Meta-Llama-3-8B"
dataset = load_dataset("json", da…
-
Hello.
I tried to install everything mentioned from git cloning to installing all requirements, except flash attentions.
I have an A100 40GB machine
CUDA 11.0
Now downloaded the llama-2-7B…
-
### Your current environment
```
#!/bin/bash
# Copyright (C) 2024 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
# Set default values
default_port=8008
default_model=$LLM_MODEL
defa…
-
## 🐛 Bug
Running a model parallel 2 with 8 gpus on FAIR cluster raises the following exception with the 1.3B_gptz model only when run with `arceasy`, `arcchallenge`, `openbookqa`. Works with `storycl…
-
## 🐛 Bug
### To Reproduce
Run this bash script to train a language model over a dataset
```
TEXT=../../data/cai
fairseq-train --cpu --task language_modeling \
$TEXT/data-bin/cai \
--s…
-
(lg) C:\Users\rsrikaan\localGpt>python run_localGPT.py
2023-12-20 15:17:05,282 - INFO - run_localGPT.py:241 - Running on: cpu
2023-12-20 15:17:05,282 - INFO - run_localGPT.py:242 - Display Source Do…