-
### Please check that this issue hasn't been reported before.
- [X] I searched previous [Bug Reports](https://github.com/axolotl-ai-cloud/axolotl/labels/bug) didn't find any similar reports.
### Exp…
-
**Describe the bug**
There is a problem with asynchronous communication in zero stage2 by using `overlap_comm`.
**To Reproduce**
Steps to reproduce the behavior:
Use deepspeed zero-2 on the hugg…
-
目前我爬取了5只股票(东方财富的资讯),大约有4w条数据,执行finetune.sh 日志如下图
![image](https://github.com/AI4Finance-Foundation/FinGPT/assets/5948532/ec2b4007-dd1d-4a60-bab8-68a036854ebd)
执行脚本参数
python -u finetune.py \
--…
-
When I run bash ``examples/gpt/pretrain_gpt_distributed.sh"
It reports the information
![image](https://user-images.githubusercontent.com/84830408/155650139-559e0ce3-3b3f-4227-9d2c-65d922e4ca9d.p…
-
I am trying to reimplement the OTAM and using the default arguments, this is options and the result in ssv2。
Options: Namespace(
dataset='data/ssv2_256x256q5',
learning_rate=0.001, tasks_per_…
-
I have only one GPU. I have set local_rank=-1 and assigned os.environ['CUDA_VISIBLE_DEVICES']='0',but failed to run the code. What do i need to revise to successfully run on one GPU?
-
I am trying to train an SDXL LoRA and for some reason, it will not train over one epoch. I need it to go for ten. It recognizes that I put in for 10 epoch but then when it starts training, it says tha…
-
## Problem
When I first started using axolotl I was frequently adjusting the configuration depending on the GPU utilization and model needs. I was recommended on Discord to execute `nvidia-smi` and…
-
### Please check that this issue hasn't been reported before.
- [X] I searched previous [Bug Reports](https://github.com/OpenAccess-AI-Collective/axolotl/labels/bug) didn't find any similar reports.
…
-