yangjianxin1 / Firefly

Firefly: 大模型训练工具,支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型
5.9k stars 527 forks source link

Qwen2-7b lora #269

Open linzm1007 opened 5 months ago

linzm1007 commented 5 months ago

[2024-06-14 02:56:48,326] [INFO] [real_accelerator.py:161:get_accelerator] Setting ds_accelerator to cuda (auto detect) Traceback (most recent call last): File "/data/mlops/code/Firefly/train.py", line 392, in main() File "/data/mlops/code/Firefly/train.py", line 375, in main args, training_args = setup_everything() File "/data/mlops/code/Firefly/train.py", line 70, in setup_everything args, training_args = parser.parse_json_file(json_file=train_args_file) File "/usr/local/miniconda/envs/car/lib/python3.9/site-packages/transformers/hf_argparser.py", line 398, in parse_json_file outputs = self.parse_dict(data, allow_extra_keys=allow_extra_keys) File "/usr/local/miniconda/envs/car/lib/python3.9/site-packages/transformers/hf_argparser.py", line 376, in parse_dict raise ValueError(f"Some keys are not used by the HfArgumentParser: {sorted(unused_keys)}") ValueError: Some keys are not used by the HfArgumentParser: ['use_unsloth']