linyiLYi / bilibot

A local chatbot fine-tuned by bilibili user comments.
Apache License 2.0
2.92k stars 341 forks source link

run python -m mlx_lm.lora --model models/Qwen1.5-32B-Chat --data data/ --train --iters 1000 --batch-size 8 --lora-layers 12 fail #25

Open biingxiing opened 1 month ago

biingxiing commented 1 month ago

command: python -m mlx_lm.lora --model models/Qwen1.5-32B-Chat --data data/ --train --iters 1000 --batch-size 8 --lora-layers 12 result: ` Loading pretrained model Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained. Trainable parameters: 0.063% (0.393M/619.570M) Loading datasets Training Starting training..., iters: 1000 In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/compiled_preamble.h:8: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/ops.h:4: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/_build_env/lib/clang/16/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:33: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/machine/_types.h:32: /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/i386/_types.h:79:3: error: typedef redefinition with different types ('union mbstate_t' vs 'union __mbstate_t') } mbstate_t; ^ /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/i386/_types.h:81:3: note: previous definition is here } mbstate_t; ^ In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/compiled_preamble.h:8: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/ops.h:4: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/_build_env/lib/clang/16/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:80: /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_pthread/_pthread_types.h:57:8: error: redefinition of 'darwin_pthread_handler_rec' struct darwin_pthread_handler_rec { ^ /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/sys/_pthread/_pthread_types.h:57:8: note: previous definition is here struct darwin_pthread_handler_rec { ^ In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/compiled_preamble.h:8: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/ops.h:4: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/_build_env/lib/clang/16/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:80: /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_pthread/_pthread_types.h:63:8: error: redefinition of '_opaque_pthread_attr_t' struct _opaque_pthread_attr_t { ^ /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/sys/_pthread/_pthread_types.h:63:8: note: previous definition is here struct _opaque_pthread_attr_t { ^ In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/compiled_preamble.h:8: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/ops.h:4: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/_build_env/lib/clang/16/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:80: /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_pthread/_pthread_types.h:68:8: error: redefinition of '_opaque_pthread_cond_t' struct _opaque_pthread_cond_t { ^ /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/sys/_pthread/_pthread_types.h:68:8: note: previous definition is here struct _opaque_pthread_cond_t { ^ In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/compiled_preamble.h:8: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/ops.h:4: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/_build_env/lib/clang/16/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:80: /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_pthread/_pthread_types.h:73:8: error: redefinition of '_opaque_pthread_condattr_t' struct _opaque_pthread_condattr_t { ^ /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/sys/_pthread/_pthread_types.h:73:8: note: previous definition is here struct _opaque_pthread_condattr_t { ^ In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/compiled_preamble.h:8: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/ops.h:4: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/_build_env/lib/clang/16/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:80: /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_pthread/_pthread_types.h:78:8: error: redefinition of '_opaque_pthread_mutex_t' struct _opaque_pthread_mutex_t { ^ /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/sys/_pthread/_pthread_types.h:78:8: note: previous definition is here struct _opaque_pthread_mutex_t { ^ In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/compiled_preamble.h:8: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/ops.h:4: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/_build_env/lib/clang/16/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:80: /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_pthread/_pthread_types.h:83:8: error: redefinition of '_opaque_pthread_mutexattr_t' struct _opaque_pthread_mutexattr_t { ^ /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/sys/_pthread/_pthread_types.h:83:8: note: previous definition is here struct _opaque_pthread_mutexattr_t { ^ In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/compiled_preamble.h:8: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/ops.h:4: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/_build_env/lib/clang/16/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:80: /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_pthread/_pthread_types.h:88:8: error: redefinition of '_opaque_pthread_once_t' struct _opaque_pthread_once_t { ^ /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/sys/_pthread/_pthread_types.h:88:8: note: previous definition is here struct _opaque_pthread_once_t { ^ In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/compiled_preamble.h:8: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/ops.h:4: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/_build_env/lib/clang/16/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:80: /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_pthread/_pthread_types.h:93:8: error: redefinition of '_opaque_pthread_rwlock_t' struct _opaque_pthread_rwlock_t { ^ /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/sys/_pthread/_pthread_types.h:93:8: note: previous definition is here struct _opaque_pthread_rwlock_t { ^ In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/compiled_preamble.h:8: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/ops.h:4: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/_build_env/lib/clang/16/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:80: /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_pthread/_pthread_types.h:98:8: error: redefinition of '_opaque_pthread_rwlockattr_t' struct _opaque_pthread_rwlockattr_t { ^ /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/sys/_pthread/_pthread_types.h:98:8: note: previous definition is here struct _opaque_pthread_rwlockattr_t { ^ In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/compiled_preamble.h:8: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/ops.h:4: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/_build_env/lib/clang/16/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:80: /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_pthread/_pthread_types.h:103:8: error: redefinition of '_opaque_pthread_t' struct _opaque_pthread_t { ^ /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/sys/_pthread/_pthread_types.h:103:8: note: previous definition is here struct _opaque_pthread_t { ^ 11 errors generated. libc++abi: terminating due to uncaught exception of type std::runtime_error: [Compile::eval_cpu] Failed to compile function Cf4BroadcastBDf4MultiplyAC_VC_f4_16039322619898613641_contiguous with error code 256.

zsh: abort sudo python -m mlx_lm.lora --model models/Qwen1.5-32B-Chat --data data/ 100 (bilibot) admin@xingbings-MacBook-Pro bilibot % python -m mlx_lm.lora --model models/Qwen1.5-32B-Chat --data data/ --train --iters 1000 --batch-size 8 --lora-layers 12

Loading pretrained model Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained. Trainable parameters: 0.063% (0.393M/619.570M) Loading datasets Training Starting training..., iters: 1000 In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/compiled_preamble.h:8: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/ops.h:4: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/_build_env/lib/clang/16/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:33: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/machine/_types.h:32: /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/i386/_types.h:79:3: error: typedef redefinition with different types ('union mbstate_t' vs 'union __mbstate_t') } mbstate_t; ^ /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/i386/_types.h:81:3: note: previous definition is here } mbstate_t; ^ In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/compiled_preamble.h:8: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/ops.h:4: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/_build_env/lib/clang/16/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:80: /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_pthread/_pthread_types.h:57:8: error: redefinition of 'darwin_pthread_handler_rec' struct darwin_pthread_handler_rec { ^ /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/sys/_pthread/_pthread_types.h:57:8: note: previous definition is here struct darwin_pthread_handler_rec { ^ In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/compiled_preamble.h:8: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/ops.h:4: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/_build_env/lib/clang/16/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:80: /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_pthread/_pthread_types.h:63:8: error: redefinition of '_opaque_pthread_attr_t' struct _opaque_pthread_attr_t { ^ /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/sys/_pthread/_pthread_types.h:63:8: note: previous definition is here struct _opaque_pthread_attr_t { ^ In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/compiled_preamble.h:8: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/ops.h:4: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/_build_env/lib/clang/16/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:80: /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_pthread/_pthread_types.h:68:8: error: redefinition of '_opaque_pthread_cond_t' struct _opaque_pthread_cond_t { ^ /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/sys/_pthread/_pthread_types.h:68:8: note: previous definition is here struct _opaque_pthread_cond_t { ^ In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/compiled_preamble.h:8: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/ops.h:4: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/_build_env/lib/clang/16/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:80: /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_pthread/_pthread_types.h:73:8: error: redefinition of '_opaque_pthread_condattr_t' struct _opaque_pthread_condattr_t { ^ /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/sys/_pthread/_pthread_types.h:73:8: note: previous definition is here struct _opaque_pthread_condattr_t { ^ In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/compiled_preamble.h:8: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/ops.h:4: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/_build_env/lib/clang/16/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:80: /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_pthread/_pthread_types.h:78:8: error: redefinition of '_opaque_pthread_mutex_t' struct _opaque_pthread_mutex_t { ^ /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/sys/_pthread/_pthread_types.h:78:8: note: previous definition is here struct _opaque_pthread_mutex_t { ^ In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/compiled_preamble.h:8: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/ops.h:4: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/_build_env/lib/clang/16/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:80: /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_pthread/_pthread_types.h:83:8: error: redefinition of '_opaque_pthread_mutexattr_t' struct _opaque_pthread_mutexattr_t { ^ /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/sys/_pthread/_pthread_types.h:83:8: note: previous definition is here struct _opaque_pthread_mutexattr_t { ^ In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/compiled_preamble.h:8: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/ops.h:4: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/_build_env/lib/clang/16/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:80: /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_pthread/_pthread_types.h:88:8: error: redefinition of '_opaque_pthread_once_t' struct _opaque_pthread_once_t { ^ /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/sys/_pthread/_pthread_types.h:88:8: note: previous definition is here struct _opaque_pthread_once_t { ^ In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/compiled_preamble.h:8: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/ops.h:4: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/_build_env/lib/clang/16/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:80: /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_pthread/_pthread_types.h:93:8: error: redefinition of '_opaque_pthread_rwlock_t' struct _opaque_pthread_rwlock_t { ^ /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/sys/_pthread/_pthread_types.h:93:8: note: previous definition is here struct _opaque_pthread_rwlock_t { ^ In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/compiled_preamble.h:8: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/ops.h:4: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/_build_env/lib/clang/16/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:80: /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_pthread/_pthread_types.h:98:8: error: redefinition of '_opaque_pthread_rwlockattr_t' struct _opaque_pthread_rwlockattr_t { ^ /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/sys/_pthread/_pthread_types.h:98:8: note: previous definition is here struct _opaque_pthread_rwlockattr_t { ^ In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/compiled_preamble.h:8: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/work/mlx/backend/common/ops.h:4: In file included from /Users/runner/miniforge3/conda-bld/mlx_1710786362019/_build_env/lib/clang/16/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/stdint.h:52: In file included from /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_types.h:80: /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk/usr/include/sys/_pthread/_pthread_types.h:103:8: error: redefinition of '_opaque_pthread_t' struct _opaque_pthread_t { ^ /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/sys/_pthread/_pthread_types.h:103:8: note: previous definition is here struct _opaque_pthread_t { ^ 11 errors generated. libc++abi: terminating due to uncaught exception of type std::runtime_error: [Compile::eval_cpu] Failed to compile function Cf4BroadcastBDf4MultiplyAC_VC_f4_16039322619898613641_contiguous with error code 256.

zsh: abort python -m mlx_lm.lora --model models/Qwen1.5-32B-Chat --data data/ --train`

what can i do?

biingxiing commented 1 month ago

my mac have not the two path: ls: /Users/runner/miniforge3/: No such file or directory ls: /Applications/Xcode_15.0.1.app/: No such file or directory

and command mlx_lm.lora --help, result is zsh: command not found: mlx_lm.lora.

i am not sure that the above two questions make my fine tune fail