AttributeError: 'LLMTrainingParams' object has no attribute 'model_fields'[BUG]

bpbeyt commented 8 months ago

Prerequisites

[X] I have read the documentation.
[X] I have checked other issues for similar problems.

Backend

Local

Interface Used

CLI

CLI Command

python script

import huggingface_hub import subprocess import os import transformers from transformers import AutoModel

os.environ['KMP_DUPLICATE_LIB_OK']='True'

command = [ "autotrain", "llm", "--train", "--project-name", "marketing", "--model", "meta-llama/Llama-2-7b-hf", "--data-path", r"C:\Users....\Tunes\train.csv", # Use raw string for Windows path "--use-peft", "--batch-size", "2", "--epochs", "3", "--trainer", "sft", "--model_max_length", "2048" ]

command_str = " ".join(command)

try: subprocess.run(command_str, shell=True, check=True) except subprocess.CalledProcessError as e: print(f"Error: {e}")

UI Screenshots & Parameters

conda environment

Name Version Build Channel abseil-cpp 20211102.0 hd77b12b_0 absl-py 2.0.0 pypi_0 pypi accelerate 0.25.0 pypi_0 pypi aiobotocore 2.5.0 py311haa95532_0 aiofiles 22.1.0 py311haa95532_0 aiohttp 3.9.0 py311h2bbff1b_0 aioitertools 0.7.1 pyhd3eb1b0_0 aiosignal 1.2.0 pyhd3eb1b0_0 aiosqlite 0.18.0 py311haa95532_0 alabaster 0.7.12 pyhd3eb1b0_0 albumentations 1.3.1 pypi_0 pypi alembic 1.13.1 pypi_0 pypi altair 5.2.0 pypi_0 pypi anaconda-anon-usage 0.4.2 py311hfc23b7f_0 anaconda-client 1.12.1 py311haa95532_0 anaconda-cloud-auth 0.1.3 py311haa95532_0 anaconda-navigator 2.5.0 py311haa95532_0 anaconda-project 0.11.1 py311haa95532_0 annotated-types 0.6.0 pypi_0 pypi anyio 3.7.1 pypi_0 pypi aom 3.6.0 hd77b12b_0 appdirs 1.4.4 pyhd3eb1b0_0 archspec 0.2.1 pyhd3eb1b0_0 argon2-cffi 21.3.0 pyhd3eb1b0_0 argon2-cffi-bindings 21.2.0 py311h2bbff1b_0 arrow 1.2.3 py311haa95532_1 arrow-cpp 11.0.0 ha81ea56_2 astroid 2.14.2 py311haa95532_0 asttokens 2.0.5 pyhd3eb1b0_0 async-timeout 4.0.2 py311haa95532_0 atomicwrites 1.4.0 py_0 attrs 23.1.0 py311haa95532_0 automat 20.2.0 py_0 autopep8 1.6.0 pyhd3eb1b0_1 autotrain-advanced 0.6.80 pypi_0 pypi aws-c-common 0.6.8 h2bbff1b_1 aws-c-event-stream 0.1.6 hd77b12b_6 aws-checksums 0.1.11 h2bbff1b_2 aws-sdk-cpp 1.8.185 hd77b12b_1 babel 2.11.0 py311haa95532_0 backcall 0.2.0 pyhd3eb1b0_0 backports 1.1 pyhd3eb1b0_0 backports.functools_lru_cache 1.6.4 pyhd3eb1b0_0 backports.tempfile 1.0 pyhd3eb1b0_1 backports.weakref 1.0.post1 py_1 bcrypt 3.2.0 py311h2bbff1b_1 beautifulsoup4 4.12.2 py311haa95532_0 binaryornot 0.4.4 pyhd3eb1b0_1 bitsandbytes 0.41.0 pypi_0 pypi black 23.3.0 py311haa95532_0 blas 1.0 mkl bleach 4.1.0 pyhd3eb1b0_0 blosc 1.21.3 h6c2663c_0 boltons 23.0.0 py311haa95532_0 boost-cpp 1.82.0 h59b6b97_1 botocore 1.29.76 py311haa95532_0 bottleneck 1.3.5 py311h5bb9823_0 brotli 1.1.0 pypi_0 pypi brotli-bin 1.0.9 h2bbff1b_7 brotli-python 1.0.9 py311hd77b12b_7 brotlipy 0.7.0 py311h2bbff1b_1002 bzip2 1.0.8 he774522_0 c-ares 1.19.1 h2bbff1b_0 c-blosc2 2.8.0 hd77b12b_0 ca-certificates 2023.12.12 haa95532_0 cachetools 5.3.2 pypi_0 pypi certifi 2023.11.17 py311haa95532_0 cffi 1.16.0 py311h2bbff1b_0 cfitsio 3.470 h2bbff1b_7 chardet 4.0.0 py311haa95532_1003 charls 2.2.0 h6c2663c_0 charset-normalizer 2.0.4 pyhd3eb1b0_0 click 8.1.7 py311haa95532_0 cloudpickle 2.2.1 py311haa95532_0 clyent 1.2.2 py311haa95532_1 cmaes 0.10.0 pypi_0 pypi codecarbon 2.2.3 pypi_0 pypi colorama 0.4.6 py311haa95532_0 colorcet 3.0.1 py311haa95532_0 colorlog 6.8.0 pypi_0 pypi comm 0.1.2 py311haa95532_0 conda 23.11.0 py311haa95532_0 conda-build 3.28.2 py311haa95532_0 conda-content-trust 0.2.0 py311haa95532_0 conda-index 0.3.0 py311haa95532_0 conda-libmamba-solver 23.12.0 pyhd3eb1b0_1 conda-pack 0.6.0 pyhd3eb1b0_0 conda-package-handling 2.2.0 py311haa95532_0 conda-package-streaming 0.9.0 py311haa95532_0 conda-repo-cli 1.0.75 py311haa95532_0 conda-token 0.4.0 pyhd3eb1b0_0 conda-verify 3.4.2 py_1 console_shortcut 0.1.1 4 constantly 23.10.4 py311haa95532_0 cookiecutter 1.7.3 pyhd3eb1b0_0 cryptography 41.0.7 py311h89fc84f_0 cssselect 1.1.0 pyhd3eb1b0_0 cuda-cccl 12.3.101 0 nvidia cuda-cudart 11.8.89 0 nvidia cuda-cudart-dev 11.8.89 0 nvidia cuda-cupti 11.8.87 0 nvidia cuda-libraries 11.8.0 0 nvidia cuda-libraries-dev 11.8.0 0 nvidia cuda-nvrtc 11.8.89 0 nvidia cuda-nvrtc-dev 11.8.89 0 nvidia cuda-nvtx 11.8.86 0 nvidia cuda-profiler-api 12.3.101 0 nvidia cuda-runtime 11.8.0 0 nvidia curl 8.1.1 h2bbff1b_0 cycler 0.11.0 pyhd3eb1b0_0 cytoolz 0.12.0 py311h2bbff1b_0 dal 2023.1.1 h59b6b97_48681 dask-core 2023.6.0 py311haa95532_0 datasets 2.14.7 pypi_0 pypi dav1d 1.2.1 h2bbff1b_0 debugpy 1.6.7 py311hd77b12b_0 decorator 5.1.1 pyhd3eb1b0_0 defusedxml 0.7.1 pyhd3eb1b0_0 diff-match-patch 20200713 pyhd3eb1b0_0 diffusers 0.21.4 pypi_0 pypi dill 0.3.7 py311haa95532_0 distributed 2023.6.0 py311haa95532_0 distro 1.8.0 py311haa95532_0 docstring-parser 0.15 pypi_0 pypi docstring-to-markdown 0.11 py311haa95532_0 docutils 0.18.1 py311haa95532_3 einops 0.6.1 pypi_0 pypi entrypoints 0.4 py311haa95532_0 et_xmlfile 1.1.0 py311haa95532_0 evaluate 0.3.0 pypi_0 pypi executing 0.8.3 pyhd3eb1b0_0 fastapi 0.104.1 pypi_0 pypi ffmpy 0.3.1 pypi_0 pypi filelock 3.13.1 py311haa95532_0 flake8 6.0.0 py311haa95532_0 flask 2.2.2 py311haa95532_0 fmt 9.1.0 h6d14046_0 fonttools 4.25.0 pyhd3eb1b0_0 freetype 2.12.1 ha860e81_0 frozenlist 1.4.0 py311h2bbff1b_0 fsspec 2023.10.0 pypi_0 pypi future 0.18.3 py311haa95532_0 fuzzywuzzy 0.18.0 pypi_0 pypi gflags 2.2.2 ha925a31_0 giflib 5.2.1 h8cc25b3_3 git 2.40.1 haa95532_1 glib 2.69.1 h5dc1a3c_2 glob2 0.7 pyhd3eb1b0_0 glog 0.5.0 hd77b12b_0 google-auth 2.25.2 pypi_0 pypi google-auth-oauthlib 1.2.0 pypi_0 pypi gradio 3.41.0 pypi_0 pypi gradio-client 0.5.0 pypi_0 pypi greenlet 2.0.1 py311hd77b12b_0 grpc-cpp 1.48.2 hfe90ff0_1 grpcio 1.60.0 pypi_0 pypi h11 0.14.0 pypi_0 pypi hdf5 1.12.1 h51c971a_3 heapdict 1.0.1 pyhd3eb1b0_0 hf-transfer 0.1.4 pypi_0 pypi httpcore 1.0.2 pypi_0 pypi httpx 0.26.0 pypi_0 pypi huggingface-hub 0.20.1 pypi_0 pypi hyperlink 21.0.0 pyhd3eb1b0_0 icc_rt 2022.1.0 h6049295_2 icu 73.1 h6c2663c_0 idna 3.4 py311haa95532_0 imagesize 1.4.1 py311haa95532_0 importlib-metadata 7.0.0 py311haa95532_1 importlib-resources 6.1.1 pypi_0 pypi importlib_metadata 7.0.0 hd3eb1b0_1 incremental 21.3.0 pyhd3eb1b0_0 inflate64 1.0.0 pypi_0 pypi inflection 0.5.1 py311haa95532_0 iniconfig 1.1.1 pyhd3eb1b0_0 inquirerpy 0.3.4 pypi_0 pypi intel-openmp 2023.1.0 h59b6b97_46319 intervaltree 3.1.0 pyhd3eb1b0_0 invisible-watermark 0.2.0 pypi_0 pypi ipadic 1.0.0 pypi_0 pypi ipykernel 6.25.0 py311h746a85d_0 ipython 8.15.0 py311haa95532_0 ipython_genutils 0.2.0 pyhd3eb1b0_1 ipywidgets 8.0.4 py311haa95532_0 isort 5.9.3 pyhd3eb1b0_0 itemadapter 0.3.0 pyhd3eb1b0_0 itemloaders 1.0.4 pyhd3eb1b0_1 itsdangerous 2.0.1 pyhd3eb1b0_0 jaraco.classes 3.2.1 pyhd3eb1b0_0 jedi 0.18.1 py311haa95532_1 jellyfish 1.0.1 py311h36a85e1_0 jinja2 3.1.2 py311haa95532_0 jinja2-time 0.2.0 pyhd3eb1b0_3 jiwer 3.0.2 pypi_0 pypi jmespath 1.0.1 py311haa95532_0 joblib 1.3.1 pypi_0 pypi jpeg 9e h2bbff1b_1 jq 1.6 haa95532_1 json5 0.9.6 pyhd3eb1b0_0 jsonpatch 1.32 pyhd3eb1b0_0 jsonpointer 2.1 pyhd3eb1b0_0 jsonschema 4.19.2 py311haa95532_0 jsonschema-specifications 2023.7.1 py311haa95532_0 jupyter 1.0.0 py311haa95532_8 jupyter_client 7.4.9 py311haa95532_0 jupyter_console 6.6.3 py311haa95532_0 jupyter_core 5.5.0 py311haa95532_0 jupyter_events 0.8.0 py311haa95532_0 jupyter_server 1.23.4 py311haa95532_0 jupyter_server_fileid 0.9.0 py311haa95532_0 jupyter_server_ydoc 0.8.0 py311haa95532_1 jupyter_ydoc 0.2.4 py311haa95532_0 jupyterlab 3.6.3 py311haa95532_0 jupyterlab_pygments 0.2.2 py311haa95532_0 jupyterlab_server 2.22.0 py311haa95532_0 jupyterlab_widgets 3.0.9 py311haa95532_0 kaleido-core 0.2.1 h2bbff1b_0 keyring 23.13.1 py311haa95532_0 kiwisolver 1.4.4 py311hd77b12b_0 krb5 1.20.1 h5b6d351_0 lazy-object-proxy 1.6.0 py311h2bbff1b_0 lazy_loader 0.2 py311haa95532_0 lcms2 2.12 h83e58a3_0 lerc 3.0 hd77b12b_0 libaec 1.0.4 h33f27b4_1 libarchive 3.6.2 hb62f4d4_2 libavif 0.11.1 h2bbff1b_0 libboost 1.82.0 hae598e9_1 libbrotlicommon 1.0.9 h2bbff1b_7 libbrotlidec 1.0.9 h2bbff1b_7 libbrotlienc 1.0.9 h2bbff1b_7 libclang 14.0.6 default_hb5a9fac_1 libclang13 14.0.6 default_h8e68704_1 libcublas 11.11.3.6 0 nvidia libcublas-dev 11.11.3.6 0 nvidia libcufft 10.9.0.58 0 nvidia libcufft-dev 10.9.0.58 0 nvidia libcurand 10.3.4.107 0 nvidia libcurand-dev 10.3.4.107 0 nvidia libcurl 8.4.0 h86230a5_1 libcusolver 11.4.1.48 0 nvidia libcusolver-dev 11.4.1.48 0 nvidia libcusparse 11.7.5.86 0 nvidia libcusparse-dev 11.7.5.86 0 nvidia libdeflate 1.17 h2bbff1b_1 libevent 2.1.12 h56d1f94_1 libffi 3.4.4 hd77b12b_0 libiconv 1.16 h2bbff1b_2 libjpeg-turbo 2.0.0 h196d8e1_0 liblief 0.12.3 hd77b12b_0 libmamba 1.5.6 hcd6fe79_0 libmambapy 1.5.6 py311h77c03ed_0 libnpp 11.8.0.86 0 nvidia libnpp-dev 11.8.0.86 0 nvidia libnvjpeg 11.9.0.86 0 nvidia libnvjpeg-dev 11.9.0.86 0 nvidia libpng 1.6.39 h8cc25b3_0 libpq 12.15 h906ac69_1 libprotobuf 3.20.3 h23ce68f_0 libsodium 1.0.18 h62dcd97_0 libsolv 0.7.24 h23ce68f_0 libspatialindex 1.9.3 h6c2663c_0 libssh2 1.10.0 he2ea4bf_2 libthrift 0.15.0 h4364b78_2 libtiff 4.5.1 hd77b12b_0 libuv 1.44.2 h2bbff1b_0 libwebp 1.3.2 hbc33d0d_0 libwebp-base 1.3.2 h2bbff1b_0 libxml2 2.10.4 h0ad7f3c_1 libxslt 1.1.37 h2bbff1b_1 libzopfli 1.0.3 ha925a31_0 linkify-it-py 2.0.0 py311haa95532_0 llvmlite 0.40.0 py311hf2fb9eb_0 locket 1.0.0 py311haa95532_0 loguru 0.7.0 pypi_0 pypi lxml 4.9.3 py311h09808a7_0 lz4 4.3.2 py311h2bbff1b_0 lz4-c 1.9.4 h2bbff1b_0 lzo 2.10 he774522_2 m2-msys2-runtime 2.5.0.17080.65c939c 3 m2-patch 2.7.5 2 m2w64-libwinpthread-git 5.0.0.4634.697f757 2 mako 1.3.0 pypi_0 pypi markdown 3.4.1 py311haa95532_0 markdown-it-py 2.2.0 py311haa95532_1 markupsafe 2.1.3 py311h2bbff1b_0 mathjax 2.7.5 haa95532_0 matplotlib-inline 0.1.6 py311haa95532_0 mccabe 0.7.0 pyhd3eb1b0_0 mdit-py-plugins 0.3.0 py311haa95532_0 mdurl 0.1.0 py311haa95532_0 menuinst 1.4.19 py311h59b6b97_1 mistune 2.0.4 py311haa95532_0 mkl 2023.1.0 h6b88ed4_46357 mkl-service 2.4.0 py311h2bbff1b_1 mkl_fft 1.3.8 py311h2bbff1b_0 mkl_random 1.2.4 py311h59b6b97_0 more-itertools 10.1.0 py311haa95532_0 mpmath 1.3.0 py311haa95532_0 msgpack-python 1.0.3 py311h59b6b97_0 msys2-conda-epoch 20160418 1 multidict 6.0.4 py311h2bbff1b_0 multipledispatch 0.6.0 py311haa95532_0 multiprocess 0.70.14 py311haa95532_0 multivolumefile 0.2.3 pypi_0 pypi munkres 1.1.4 py_0 mypy_extensions 1.0.0 py311haa95532_0 navigator-updater 0.4.0 py311haa95532_1 nbclassic 0.5.5 py311haa95532_0 nbclient 0.8.0 py311haa95532_0 nbconvert 7.10.0 py311haa95532_0 nbformat 5.9.2 py311haa95532_0 nest-asyncio 1.5.6 py311haa95532_0 networkx 3.1 py311haa95532_0 ninja 1.10.2 haa95532_5 ninja-base 1.10.2 h6d14046_5 nltk 3.8.1 py311haa95532_0 nomkl 0.0.3 pypi_0 pypi notebook 6.5.4 py311haa95532_1 notebook-shim 0.2.2 py311haa95532_0 numexpr 2.8.7 py311h1fcbade_0 numpy 1.24.3 py311hdab7c0b_1 numpy-base 1.24.3 py311hd01c5d8_1 numpydoc 1.5.0 py311haa95532_0 oauthlib 3.2.2 pypi_0 pypi opencv-python 4.9.0.80 pypi_0 pypi opencv-python-headless 4.9.0.80 pypi_0 pypi openjpeg 2.4.0 h4fc8c34_0 openpyxl 3.0.10 py311h2bbff1b_0 openssl 3.0.12 h2bbff1b_0 optuna 3.3.0 pypi_0 pypi orc 1.7.4 h623e30f_1 orjson 3.9.10 pypi_0 pypi packaging 23.1 py311haa95532_0 pandas 2.1.4 py311hf62ec03_0 pandocfilters 1.5.0 pyhd3eb1b0_0 param 1.13.0 py311haa95532_0 paramiko 2.8.1 pyhd3eb1b0_0 parsel 1.6.0 py311haa95532_0 parso 0.8.3 pyhd3eb1b0_0 partd 1.4.1 py311haa95532_0 pathlib 1.0.1 pyhd3eb1b0_1 pathspec 0.10.3 py311haa95532_0 pcre 8.45 hd77b12b_0 pcre2 10.42 h0ff8eda_0 peft 0.7.1 pypi_0 pypi pep8 1.7.1 py311haa95532_1 pexpect 4.8.0 pyhd3eb1b0_3 pfzy 0.3.4 pypi_0 pypi pickleshare 0.7.5 pyhd3eb1b0_1003 pillow 10.0.0 pypi_0 pypi pip 23.3.1 py311haa95532_0 pkce 1.0.3 py311haa95532_0 pkginfo 1.9.6 py311haa95532_0 platformdirs 3.10.0 py311haa95532_0 plotly 5.9.0 py311haa95532_0 pluggy 1.0.0 py311haa95532_1 ply 3.11 py311haa95532_0 powershell_shortcut 0.0.1 3 poyo 0.5.0 pyhd3eb1b0_0 prometheus_client 0.14.1 py311haa95532_0 prompt-toolkit 3.0.36 py311haa95532_0 prompt_toolkit 3.0.36 hd3eb1b0_0 protego 0.1.16 py_0 protobuf 4.23.4 pypi_0 pypi psutil 5.9.0 py311h2bbff1b_0 ptyprocess 0.7.0 pyhd3eb1b0_2 pure_eval 0.2.2 pyhd3eb1b0_0 py-cpuinfo 8.0.0 pyhd3eb1b0_1 py-lief 0.12.3 py311hd77b12b_0 py7zr 0.20.6 pypi_0 pypi pyarrow 11.0.0 py311h8a3a540_1 pyarrow-hotfix 0.6 pypi_0 pypi pyasn1 0.4.8 pyhd3eb1b0_0 pyasn1-modules 0.2.8 py_0 pybcj 1.0.2 pypi_0 pypi pybind11-abi 4 hd3eb1b0_1 pycodestyle 2.10.0 py311haa95532_0 pycosat 0.6.6 py311h2bbff1b_0 pycparser 2.21 pyhd3eb1b0_0 pycryptodomex 3.19.1 pypi_0 pypi pyct 0.5.0 py311haa95532_0 pycurl 7.45.2 py311he2ea4bf_1 pydantic 2.4.2 pypi_0 pypi pydantic-core 2.10.1 pypi_0 pypi pydispatcher 2.0.5 py311haa95532_2 pydocstyle 6.3.0 py311haa95532_0 pydub 0.25.1 pypi_0 pypi pyflakes 3.0.1 py311haa95532_0 pygments 2.15.1 py311haa95532_1 pyjwt 2.4.0 py311haa95532_0 pylint 2.16.2 py311haa95532_0 pylint-venv 2.3.0 py311haa95532_0 pyls-spyder 0.4.0 pyhd3eb1b0_0 pynacl 1.5.0 py311h8cc25b3_0 pyngrok 7.0.3 pypi_0 pypi pynvml 11.5.0 pypi_0 pypi pyodbc 4.0.34 py311hd77b12b_0 pyopenssl 23.2.0 py311haa95532_0 pyparsing 3.0.9 py311haa95532_0 pyppmd 1.0.0 pypi_0 pypi pyqt 5.15.10 py311hd77b12b_0 pyqt5-sip 12.13.0 py311h2bbff1b_0 pyqtwebengine 5.15.10 py311hd77b12b_0 pyrsistent 0.18.0 py311h2bbff1b_0 pysocks 1.7.1 py311haa95532_0 pytest 7.4.0 py311haa95532_0 python 3.11.5 he1021f5_0 python-dateutil 2.8.2 pyhd3eb1b0_0 python-dotenv 0.21.0 py311haa95532_0 python-fastjsonschema 2.16.2 py311haa95532_0 python-json-logger 2.0.7 py311haa95532_0 python-kaleido 0.2.1 py311haa95532_0 python-libarchive-c 2.9 pyhd3eb1b0_1 python-lmdb 1.4.1 py311hd77b12b_0 python-lsp-black 1.2.1 py311haa95532_0 python-lsp-jsonrpc 1.0.0 pyhd3eb1b0_0 python-lsp-server 1.7.2 py311haa95532_0 python-multipart 0.0.6 pypi_0 pypi python-slugify 5.0.2 pyhd3eb1b0_0 python-snappy 0.6.1 py311hd77b12b_0 python-tzdata 2023.3 pyhd3eb1b0_0 python-xxhash 2.0.2 py311h2bbff1b_1 pytoolconfig 1.2.6 py311haa95532_0 pytorch 2.1.2 py3.11_cuda11.8_cudnn8_0 pytorch pytorch-cuda 11.8 h24eeafa_5 pytorch pytorch-mutex 1.0 cuda pytorch pytz 2023.3.post1 py311haa95532_0 pyviz_comms 2.3.0 py311haa95532_0 pywavelets 1.5.0 pypi_0 pypi pywin32 305 py311h2bbff1b_0 pywin32-ctypes 0.2.0 py311haa95532_1000 pywinpty 2.0.10 py311h5da7b33_0 pyyaml 6.0.1 py311h2bbff1b_0 pyzmq 23.2.0 py311hd77b12b_0 pyzstd 0.15.9 pypi_0 pypi qdarkstyle 3.0.2 pyhd3eb1b0_0 qstylizer 0.2.2 py311haa95532_0 qt-main 5.15.2 h19c9488_10 qt-webengine 5.15.9 h5bd16bc_7 qtawesome 1.2.2 py311haa95532_0 qtconsole 5.4.2 py311haa95532_0 qtpy 2.4.1 py311haa95532_0 qtwebkit 5.212 h2bbfb41_5 qudida 0.0.4 pypi_0 pypi queuelib 1.6.2 py311haa95532_0 rapidfuzz 2.13.7 pypi_0 pypi re2 2022.04.01 hd77b12b_0 referencing 0.30.2 py311haa95532_0 regex 2023.10.3 py311h2bbff1b_0 reproc 14.2.4 hd77b12b_1 reproc-cpp 14.2.4 hd77b12b_1 requests 2.31.0 py311haa95532_0 requests-file 1.5.1 pyhd3eb1b0_0 requests-oauthlib 1.3.1 pypi_0 pypi requests-toolbelt 1.0.0 py311haa95532_0 responses 0.13.3 pyhd3eb1b0_0 rfc3339-validator 0.1.4 py311haa95532_0 rfc3986-validator 0.1.1 py311haa95532_0 rich 13.7.0 pypi_0 pypi rope 1.7.0 py311haa95532_0 rouge-score 0.1.2 pypi_0 pypi rpds-py 0.10.6 py311h062c2fa_0 rsa 4.9 pypi_0 pypi rtree 1.0.1 py311h2eaa2aa_0 ruamel.yaml 0.17.21 py311h2bbff1b_0 ruamel_yaml 0.17.21 py311h2bbff1b_0 s3fs 2023.4.0 py311haa95532_0 sacremoses 0.0.53 pypi_0 pypi safetensors 0.3.2 py311h062c2fa_0 scikit-learn 1.3.0 py311hf62ec03_0 scipy 1.11.4 py311hc1ccb85_0 scrapy 2.8.0 py311haa95532_0 semantic-version 2.10.0 pypi_0 pypi send2trash 1.8.2 py311haa95532_0 sentencepiece 0.1.99 pypi_0 pypi service_identity 18.1.0 pyhd3eb1b0_1 setuptools 68.0.0 py311haa95532_0 shtab 1.6.5 pypi_0 pypi sip 6.7.12 py311hd77b12b_0 six 1.16.0 pyhd3eb1b0_1 smart_open 5.2.1 py311haa95532_0 snappy 1.1.9 h6c2663c_0 sniffio 1.2.0 py311haa95532_1 snowballstemmer 2.2.0 pyhd3eb1b0_0 sortedcontainers 2.4.0 pyhd3eb1b0_0 soupsieve 2.5 py311haa95532_0 sphinx 5.0.2 py311haa95532_0 sphinxcontrib-applehelp 1.0.2 pyhd3eb1b0_0 sphinxcontrib-devhelp 1.0.2 pyhd3eb1b0_0 sphinxcontrib-htmlhelp 2.0.0 pyhd3eb1b0_0 sphinxcontrib-jsmath 1.0.1 pyhd3eb1b0_0 sphinxcontrib-qthelp 1.0.3 pyhd3eb1b0_0 sphinxcontrib-serializinghtml 1.1.5 pyhd3eb1b0_0 spyder 5.4.3 py311haa95532_1 spyder-kernels 2.4.4 py311haa95532_0 sqlalchemy 1.4.39 py311h2bbff1b_0 sqlite 3.41.2 h2bbff1b_0 stack_data 0.2.0 pyhd3eb1b0_0 starlette 0.27.0 pypi_0 pypi sympy 1.11.1 py311haa95532_0 tabulate 0.8.10 py311haa95532_0 tbb 2021.8.0 h59b6b97_0 tbb4py 2021.8.0 py311h59b6b97_0 tblib 1.7.0 pyhd3eb1b0_0 tenacity 8.2.2 py311haa95532_0 tensorboard 2.15.1 pypi_0 pypi tensorboard-data-server 0.7.2 pypi_0 pypi terminado 0.17.1 py311haa95532_0 text-unidecode 1.3 pyhd3eb1b0_0 textdistance 4.2.1 pyhd3eb1b0_0 texttable 1.7.0 pypi_0 pypi threadpoolctl 2.2.0 pyh0d69192_0 three-merge 0.1.1 pyhd3eb1b0_0 tiktoken 0.5.1 pypi_0 pypi tinycss2 1.2.1 py311haa95532_0 tk 8.6.12 h2bbff1b_0 tldextract 3.2.0 pyhd3eb1b0_0 tokenizers 0.15.0 pypi_0 pypi toml 0.10.2 pyhd3eb1b0_0 tomlkit 0.11.1 py311haa95532_0 toolz 0.12.0 py311haa95532_0 torch 2.1.2 pypi_0 pypi torchaudio 2.1.2 pypi_0 pypi torchvision 0.16.2 pypi_0 pypi tornado 6.3.3 py311h2bbff1b_0 tqdm 4.65.0 py311h746a85d_0 traitlets 5.7.1 py311haa95532_0 transformers 4.36.1 pypi_0 pypi trl 0.7.4 pypi_0 pypi truststore 0.8.0 py311haa95532_0 twisted 22.10.0 py311h2bbff1b_0 twisted-iocpsupport 1.0.2 py311h2bbff1b_0 typing-extensions 4.9.0 pypi_0 pypi typing_extensions 4.7.1 py311haa95532_0 tyro 0.6.3 pypi_0 pypi tzdata 2023c h04d1e81_0 uc-micro-py 1.0.1 py311haa95532_0 ujson 5.4.0 py311hd77b12b_0 unidecode 1.2.0 pyhd3eb1b0_0 urllib3 1.26.18 py311haa95532_0 utf8proc 2.6.1 h2bbff1b_0 uvicorn 0.22.0 pypi_0 pypi vc 14.2 h21ff451_1 vs2015_runtime 14.27.29016 h5e58377_2 w3lib 1.21.0 pyhd3eb1b0_0 watchdog 2.1.6 py311haa95532_0 wcwidth 0.2.5 pyhd3eb1b0_0 webencodings 0.5.1 py311haa95532_1 websocket-client 0.58.0 py311haa95532_4 websockets 11.0.3 pypi_0 pypi werkzeug 2.3.6 pypi_0 pypi whatthepatch 1.0.2 py311haa95532_0 wheel 0.38.4 py311haa95532_0 widgetsnbextension 4.0.5 py311haa95532_0 win32-setctime 1.1.0 pypi_0 pypi win_inet_pton 1.1.0 py311haa95532_0 winpty 0.4.3 4 wrapt 1.14.1 py311h2bbff1b_0 xgboost 1.7.6 pypi_0 pypi xlwings 0.29.1 py311haa95532_0 xxhash 0.8.0 h2bbff1b_3 xyzservices 2022.9.0 py311haa95532_1 xz 5.4.5 h8cc25b3_0 y-py 0.5.9 py311hb6bf4ef_0 yaml 0.2.5 he774522_0 yaml-cpp 0.8.0 hd77b12b_0 yapf 0.31.0 pyhd3eb1b0_0 yarl 1.9.3 py311h2bbff1b_0 ypy-websocket 0.8.2 py311haa95532_0 zeromq 4.3.4 hd77b12b_0 zfp 1.0.0 hd77b12b_0 zict 3.0.0 py311haa95532_0 zipp 3.17.0 py311haa95532_0 zlib 1.2.13 h8cc25b3_0 zlib-ng 2.0.7 h2bbff1b_0 zope 1.0 py311haa95532_1 zope.interface 5.4.0 py311h2bbff1b_0 zstandard 0.19.0 py311h2bbff1b_0 zstd 1.5.5 hd43e919_0

Error Logs

File "C:\Users......\anaconda3\Lib\site-packages\autotrain\cli\autotrain.py", line 48, in main command.run() File "C:\Users......\anaconda3\Lib\site-packages\autotrain\cli\run_llm.py", line 332, in run params = LLMTrainingParams( ^^^^^^^^^^^^^^^^^^ File "C:\Users......\anaconda3\Lib\site-packages\autotrain\trainers\common.py", line 130, in init defaults = set(self.model_fields.keys()) ^^^^^^^^^^^^^^^^^ AttributeError: 'LLMTrainingParams' object has no attribute 'model_fields' Error: Command 'autotrain llm --train --project-name marketing --model meta-llama/Llama-2-7b-hf --data-path C:\Users.....\Tunes\train.csv --use-peft --batch-size 2 --epochs 3 --trainer sft --model_max_length 2048' returned non-zero exit status 1.

Additional Information

this came back from prompt:

INFO Running LLM INFO Params: Namespace(version=False, text_column='text', rejected_text_column='rejected', prompt_text_column='prompt', model_ref=None, warmup_ratio=0.1, optimizer='adamw_torch', scheduler='linear', weight_decay=0.0, max_grad_norm=1.0, add_eos_token=False, block_size=-1, peft=True, lora_r=16, lora_alpha=32, lora_dropout=0.05, logging_steps=-1, evaluation_strategy='epoch', save_total_limit=1, save_strategy='epoch', auto_find_batch_size=False, mixed_precision=None, quantization=None, model_max_length=2048, trainer='sft', target_modules=None, merge_adapter=False, use_flash_attention_2=False, dpo_beta=0.1, apply_chat_template=False, padding=None, train=True, deploy=False, inference=False, username=None, backend='local-cli', token=None, repo_id=None, push_to_hub=False, model='TinyPixel/Llama-2-7B-bf16-sharded', project_name='marketing', seed=42, epochs=3, gradient_accumulation=1, disable_gradient_checkpointing=False, lr=0.0005, log='none', data_path='C:\Users\......\Tunes\train.csv', train_split='train', valid_split=None, batch_size=2, func=<function run_llm_command_factory at 0x000001B2F5704680>)

abhishekkrthakur commented 8 months ago

please use thelatest version from pip. your pydantic seems to be old

bpbeyt commented 8 months ago

Thank you Abhiskek, your advice above made the difference in getting past a ton of python dependency issues.

also, the original deployment I was trying to launch was in windows... at the point where I started to get errors with bitsandbytes, which seems most likely a linux module, I have switched over to linux. and all deployment is working as described.

huggingface / autotrain-advanced