search

huggingface / autotrain-advanced

🤗 AutoTrain Advanced
https://huggingface.co/autotrain
Apache License 2.0
3.99k stars 485 forks source link

[BUG] Unknown task: token-classification #524

Closed PiotrekGa closed 8 months ago

PiotrekGa commented 8 months ago

Prerequisites

Backend

Hugging Face Space/Endpoints

Interface Used

UI

CLI Command

No response

UI Screenshots & Parameters

No response

Error Logs



==========
== CUDA ==
==========

CUDA Version 12.1.1

Container image Copyright (c) 2016-2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved.

This container image and its contents are governed by the NVIDIA Deep Learning Container License.
By pulling and using the container, you accept the terms and conditions of this license:
https://developer.nvidia.com/ngc/nvidia-deep-learning-container-license

A copy of this license is made available in this container at /NGC-DL-CONTAINER-LICENSE for your convenience.

Found existing installation: autotrain-advanced 0.6.94.dev0
Uninstalling autotrain-advanced-0.6.94.dev0:
  Successfully uninstalled autotrain-advanced-0.6.94.dev0
Collecting autotrain-advanced
  Downloading autotrain_advanced-0.6.93-py3-none-any.whl.metadata (11 kB)
Requirement already satisfied: albumentations==1.3.1 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (1.3.1)
Requirement already satisfied: codecarbon==2.2.3 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (2.2.3)
Requirement already satisfied: datasets~=2.14.0 in ./env/lib/python3.10/site-packages (from datasets[vision]~=2.14.0->autotrain-advanced) (2.14.7)
Requirement already satisfied: evaluate==0.3.0 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.3.0)
Requirement already satisfied: ipadic==1.0.0 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (1.0.0)
Requirement already satisfied: jiwer==3.0.2 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (3.0.2)
Requirement already satisfied: joblib==1.3.1 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (1.3.1)
Requirement already satisfied: loguru==0.7.0 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.7.0)
Requirement already satisfied: pandas>=1.4 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (2.2.0)
Requirement already satisfied: nltk==3.8.1 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (3.8.1)
Requirement already satisfied: optuna==3.3.0 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (3.3.0)
Requirement already satisfied: Pillow==10.0.0 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (10.0.0)
Requirement already satisfied: protobuf==4.23.4 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (4.23.4)
Requirement already satisfied: sacremoses==0.0.53 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.0.53)
Requirement already satisfied: scikit-learn==1.3.0 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (1.3.0)
Requirement already satisfied: sentencepiece==0.1.99 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.1.99)
Requirement already satisfied: tqdm==4.65.0 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (4.65.0)
Requirement already satisfied: werkzeug==2.3.6 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (2.3.6)
Requirement already satisfied: xgboost==1.7.6 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (1.7.6)
Requirement already satisfied: huggingface-hub>=0.16.4 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.20.3)
Requirement already satisfied: requests==2.31.0 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (2.31.0)
Requirement already satisfied: einops==0.6.1 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.6.1)
Requirement already satisfied: invisible-watermark==0.2.0 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.2.0)
Requirement already satisfied: packaging==23.1 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (23.1)
Requirement already satisfied: tensorboard in ./env/lib/python3.10/site-packages (from autotrain-advanced) (2.16.2)
Requirement already satisfied: peft==0.8.2 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.8.2)
Requirement already satisfied: trl==0.7.11 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.7.11)
Requirement already satisfied: tiktoken==0.5.1 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.5.1)
Requirement already satisfied: transformers==4.37.0 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (4.37.0)
Requirement already satisfied: accelerate==0.26.1 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.26.1)
Requirement already satisfied: diffusers==0.21.4 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.21.4)
Requirement already satisfied: bitsandbytes==0.42.0 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.42.0)
Requirement already satisfied: rouge-score==0.1.2 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.1.2)
Requirement already satisfied: py7zr==0.20.6 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.20.6)
Requirement already satisfied: fastapi==0.104.1 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.104.1)
Requirement already satisfied: uvicorn==0.22.0 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.22.0)
Requirement already satisfied: python-multipart==0.0.6 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.0.6)
Requirement already satisfied: gradio==3.41.0 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (3.41.0)
Requirement already satisfied: pydantic==2.4.2 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (2.4.2)
Requirement already satisfied: hf-transfer in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.1.5)
Requirement already satisfied: pyngrok==7.0.3 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (7.0.3)
Requirement already satisfied: authlib==1.3.0 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (1.3.0)
Requirement already satisfied: itsdangerous==2.1.2 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (2.1.2)
Requirement already satisfied: numpy>=1.17 in ./env/lib/python3.10/site-packages (from accelerate==0.26.1->autotrain-advanced) (1.26.3)
Requirement already satisfied: psutil in ./env/lib/python3.10/site-packages (from accelerate==0.26.1->autotrain-advanced) (5.9.8)
Requirement already satisfied: pyyaml in ./env/lib/python3.10/site-packages (from accelerate==0.26.1->autotrain-advanced) (6.0.1)
Requirement already satisfied: torch>=1.10.0 in ./env/lib/python3.10/site-packages (from accelerate==0.26.1->autotrain-advanced) (2.2.0)
Requirement already satisfied: safetensors>=0.3.1 in ./env/lib/python3.10/site-packages (from accelerate==0.26.1->autotrain-advanced) (0.4.2)
Requirement already satisfied: scipy>=1.1.0 in ./env/lib/python3.10/site-packages (from albumentations==1.3.1->autotrain-advanced) (1.12.0)
Requirement already satisfied: scikit-image>=0.16.1 in ./env/lib/python3.10/site-packages (from albumentations==1.3.1->autotrain-advanced) (0.22.0)
Requirement already satisfied: qudida>=0.0.4 in ./env/lib/python3.10/site-packages (from albumentations==1.3.1->autotrain-advanced) (0.0.4)
Requirement already satisfied: opencv-python-headless>=4.1.1 in ./env/lib/python3.10/site-packages (from albumentations==1.3.1->autotrain-advanced) (4.9.0.80)
Requirement already satisfied: cryptography in ./env/lib/python3.10/site-packages (from authlib==1.3.0->autotrain-advanced) (42.0.3)
Requirement already satisfied: arrow in ./env/lib/python3.10/site-packages (from codecarbon==2.2.3->autotrain-advanced) (1.3.0)
Requirement already satisfied: pynvml in ./env/lib/python3.10/site-packages (from codecarbon==2.2.3->autotrain-advanced) (11.5.0)
Requirement already satisfied: py-cpuinfo in ./env/lib/python3.10/site-packages (from codecarbon==2.2.3->autotrain-advanced) (9.0.0)
Requirement already satisfied: fuzzywuzzy in ./env/lib/python3.10/site-packages (from codecarbon==2.2.3->autotrain-advanced) (0.18.0)
Requirement already satisfied: click in ./env/lib/python3.10/site-packages (from codecarbon==2.2.3->autotrain-advanced) (8.1.7)
Requirement already satisfied: filelock in ./env/lib/python3.10/site-packages (from diffusers==0.21.4->autotrain-advanced) (3.13.1)
Requirement already satisfied: importlib-metadata in ./env/lib/python3.10/site-packages (from diffusers==0.21.4->autotrain-advanced) (7.0.1)
Requirement already satisfied: regex!=2019.12.17 in ./env/lib/python3.10/site-packages (from diffusers==0.21.4->autotrain-advanced) (2023.12.25)
Requirement already satisfied: dill in ./env/lib/python3.10/site-packages (from evaluate==0.3.0->autotrain-advanced) (0.3.7)
Requirement already satisfied: xxhash in ./env/lib/python3.10/site-packages (from evaluate==0.3.0->autotrain-advanced) (3.4.1)
Requirement already satisfied: multiprocess in ./env/lib/python3.10/site-packages (from evaluate==0.3.0->autotrain-advanced) (0.70.15)
Requirement already satisfied: fsspec>=2021.05.0 in ./env/lib/python3.10/site-packages (from fsspec[http]>=2021.05.0->evaluate==0.3.0->autotrain-advanced) (2023.10.0)
Requirement already satisfied: responses<0.19 in ./env/lib/python3.10/site-packages (from evaluate==0.3.0->autotrain-advanced) (0.18.0)
Requirement already satisfied: anyio<4.0.0,>=3.7.1 in ./env/lib/python3.10/site-packages (from fastapi==0.104.1->autotrain-advanced) (3.7.1)
Requirement already satisfied: starlette<0.28.0,>=0.27.0 in ./env/lib/python3.10/site-packages (from fastapi==0.104.1->autotrain-advanced) (0.27.0)
Requirement already satisfied: typing-extensions>=4.8.0 in ./env/lib/python3.10/site-packages (from fastapi==0.104.1->autotrain-advanced) (4.9.0)
Requirement already satisfied: aiofiles<24.0,>=22.0 in ./env/lib/python3.10/site-packages (from gradio==3.41.0->autotrain-advanced) (23.2.1)
Requirement already satisfied: altair<6.0,>=4.2.0 in ./env/lib/python3.10/site-packages (from gradio==3.41.0->autotrain-advanced) (5.2.0)
Requirement already satisfied: ffmpy in ./env/lib/python3.10/site-packages (from gradio==3.41.0->autotrain-advanced) (0.3.2)
Requirement already satisfied: gradio-client==0.5.0 in ./env/lib/python3.10/site-packages (from gradio==3.41.0->autotrain-advanced) (0.5.0)
Requirement already satisfied: httpx in ./env/lib/python3.10/site-packages (from gradio==3.41.0->autotrain-advanced) (0.26.0)
Requirement already satisfied: importlib-resources<7.0,>=1.3 in ./env/lib/python3.10/site-packages (from gradio==3.41.0->autotrain-advanced) (6.1.1)
Requirement already satisfied: jinja2<4.0 in ./env/lib/python3.10/site-packages (from gradio==3.41.0->autotrain-advanced) (3.1.3)
Requirement already satisfied: markupsafe~=2.0 in ./env/lib/python3.10/site-packages (from gradio==3.41.0->autotrain-advanced) (2.1.3)
Requirement already satisfied: matplotlib~=3.0 in ./env/lib/python3.10/site-packages (from gradio==3.41.0->autotrain-advanced) (3.8.3)
Requirement already satisfied: orjson~=3.0 in ./env/lib/python3.10/site-packages (from gradio==3.41.0->autotrain-advanced) (3.9.14)
Requirement already satisfied: pydub in ./env/lib/python3.10/site-packages (from gradio==3.41.0->autotrain-advanced) (0.25.1)
Requirement already satisfied: semantic-version~=2.0 in ./env/lib/python3.10/site-packages (from gradio==3.41.0->autotrain-advanced) (2.10.0)
Requirement already satisfied: websockets<12.0,>=10.0 in ./env/lib/python3.10/site-packages (from gradio==3.41.0->autotrain-advanced) (11.0.3)
Requirement already satisfied: PyWavelets>=1.1.1 in ./env/lib/python3.10/site-packages (from invisible-watermark==0.2.0->autotrain-advanced) (1.5.0)
Requirement already satisfied: opencv-python>=4.1.0.25 in ./env/lib/python3.10/site-packages (from invisible-watermark==0.2.0->autotrain-advanced) (4.9.0.80)
Requirement already satisfied: rapidfuzz==2.13.7 in ./env/lib/python3.10/site-packages (from jiwer==3.0.2->autotrain-advanced) (2.13.7)
Requirement already satisfied: alembic>=1.5.0 in ./env/lib/python3.10/site-packages (from optuna==3.3.0->autotrain-advanced) (1.13.1)
Requirement already satisfied: cmaes>=0.10.0 in ./env/lib/python3.10/site-packages (from optuna==3.3.0->autotrain-advanced) (0.10.0)
Requirement already satisfied: colorlog in ./env/lib/python3.10/site-packages (from optuna==3.3.0->autotrain-advanced) (6.8.2)
Requirement already satisfied: sqlalchemy>=1.3.0 in ./env/lib/python3.10/site-packages (from optuna==3.3.0->autotrain-advanced) (2.0.27)
Requirement already satisfied: texttable in ./env/lib/python3.10/site-packages (from py7zr==0.20.6->autotrain-advanced) (1.7.0)
Requirement already satisfied: pycryptodomex>=3.6.6 in ./env/lib/python3.10/site-packages (from py7zr==0.20.6->autotrain-advanced) (3.20.0)
Requirement already satisfied: pyzstd>=0.14.4 in ./env/lib/python3.10/site-packages (from py7zr==0.20.6->autotrain-advanced) (0.15.9)
Requirement already satisfied: pyppmd<1.1.0,>=0.18.1 in ./env/lib/python3.10/site-packages (from py7zr==0.20.6->autotrain-advanced) (1.0.0)
Requirement already satisfied: pybcj>=0.6.0 in ./env/lib/python3.10/site-packages (from py7zr==0.20.6->autotrain-advanced) (1.0.2)
Requirement already satisfied: multivolumefile>=0.2.3 in ./env/lib/python3.10/site-packages (from py7zr==0.20.6->autotrain-advanced) (0.2.3)
Requirement already satisfied: brotli>=1.0.9 in ./env/lib/python3.10/site-packages (from py7zr==0.20.6->autotrain-advanced) (1.0.9)
Requirement already satisfied: inflate64>=0.3.1 in ./env/lib/python3.10/site-packages (from py7zr==0.20.6->autotrain-advanced) (1.0.0)
Requirement already satisfied: annotated-types>=0.4.0 in ./env/lib/python3.10/site-packages (from pydantic==2.4.2->autotrain-advanced) (0.6.0)
Requirement already satisfied: pydantic-core==2.10.1 in ./env/lib/python3.10/site-packages (from pydantic==2.4.2->autotrain-advanced) (2.10.1)
Requirement already satisfied: charset-normalizer<4,>=2 in ./env/lib/python3.10/site-packages (from requests==2.31.0->autotrain-advanced) (2.0.4)
Requirement already satisfied: idna<4,>=2.5 in ./env/lib/python3.10/site-packages (from requests==2.31.0->autotrain-advanced) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in ./env/lib/python3.10/site-packages (from requests==2.31.0->autotrain-advanced) (2.1.0)
Requirement already satisfied: certifi>=2017.4.17 in ./env/lib/python3.10/site-packages (from requests==2.31.0->autotrain-advanced) (2024.2.2)
Requirement already satisfied: absl-py in ./env/lib/python3.10/site-packages (from rouge-score==0.1.2->autotrain-advanced) (2.1.0)
Requirement already satisfied: six>=1.14.0 in ./env/lib/python3.10/site-packages (from rouge-score==0.1.2->autotrain-advanced) (1.16.0)
Requirement already satisfied: threadpoolctl>=2.0.0 in ./env/lib/python3.10/site-packages (from scikit-learn==1.3.0->autotrain-advanced) (3.3.0)
Requirement already satisfied: tokenizers<0.19,>=0.14 in ./env/lib/python3.10/site-packages (from transformers==4.37.0->autotrain-advanced) (0.15.2)
Requirement already satisfied: tyro>=0.5.11 in ./env/lib/python3.10/site-packages (from trl==0.7.11->autotrain-advanced) (0.7.3)
Requirement already satisfied: h11>=0.8 in ./env/lib/python3.10/site-packages (from uvicorn==0.22.0->autotrain-advanced) (0.14.0)
Requirement already satisfied: pyarrow>=8.0.0 in ./env/lib/python3.10/site-packages (from datasets~=2.14.0->datasets[vision]~=2.14.0->autotrain-advanced) (15.0.0)
Requirement already satisfied: pyarrow-hotfix in ./env/lib/python3.10/site-packages (from datasets~=2.14.0->datasets[vision]~=2.14.0->autotrain-advanced) (0.6)
Requirement already satisfied: aiohttp in ./env/lib/python3.10/site-packages (from datasets~=2.14.0->datasets[vision]~=2.14.0->autotrain-advanced) (3.9.3)
Requirement already satisfied: python-dateutil>=2.8.2 in ./env/lib/python3.10/site-packages (from pandas>=1.4->autotrain-advanced) (2.8.2)
Requirement already satisfied: pytz>=2020.1 in ./env/lib/python3.10/site-packages (from pandas>=1.4->autotrain-advanced) (2024.1)
Requirement already satisfied: tzdata>=2022.7 in ./env/lib/python3.10/site-packages (from pandas>=1.4->autotrain-advanced) (2024.1)
Requirement already satisfied: grpcio>=1.48.2 in ./env/lib/python3.10/site-packages (from tensorboard->autotrain-advanced) (1.60.1)
Requirement already satisfied: markdown>=2.6.8 in ./env/lib/python3.10/site-packages (from tensorboard->autotrain-advanced) (3.5.2)
Requirement already satisfied: setuptools>=41.0.0 in ./env/lib/python3.10/site-packages (from tensorboard->autotrain-advanced) (68.2.2)
Requirement already satisfied: tensorboard-data-server<0.8.0,>=0.7.0 in ./env/lib/python3.10/site-packages (from tensorboard->autotrain-advanced) (0.7.2)
Requirement already satisfied: Mako in ./env/lib/python3.10/site-packages (from alembic>=1.5.0->optuna==3.3.0->autotrain-advanced) (1.3.2)
Requirement already satisfied: jsonschema>=3.0 in ./env/lib/python3.10/site-packages (from altair<6.0,>=4.2.0->gradio==3.41.0->autotrain-advanced) (4.21.1)
Requirement already satisfied: toolz in ./env/lib/python3.10/site-packages (from altair<6.0,>=4.2.0->gradio==3.41.0->autotrain-advanced) (0.12.1)
Requirement already satisfied: sniffio>=1.1 in ./env/lib/python3.10/site-packages (from anyio<4.0.0,>=3.7.1->fastapi==0.104.1->autotrain-advanced) (1.3.0)
Requirement already satisfied: exceptiongroup in ./env/lib/python3.10/site-packages (from anyio<4.0.0,>=3.7.1->fastapi==0.104.1->autotrain-advanced) (1.2.0)
Requirement already satisfied: aiosignal>=1.1.2 in ./env/lib/python3.10/site-packages (from aiohttp->datasets~=2.14.0->datasets[vision]~=2.14.0->autotrain-advanced) (1.3.1)
Requirement already satisfied: attrs>=17.3.0 in ./env/lib/python3.10/site-packages (from aiohttp->datasets~=2.14.0->datasets[vision]~=2.14.0->autotrain-advanced) (23.2.0)
Requirement already satisfied: frozenlist>=1.1.1 in ./env/lib/python3.10/site-packages (from aiohttp->datasets~=2.14.0->datasets[vision]~=2.14.0->autotrain-advanced) (1.4.1)
Requirement already satisfied: multidict<7.0,>=4.5 in ./env/lib/python3.10/site-packages (from aiohttp->datasets~=2.14.0->datasets[vision]~=2.14.0->autotrain-advanced) (6.0.5)
Requirement already satisfied: yarl<2.0,>=1.0 in ./env/lib/python3.10/site-packages (from aiohttp->datasets~=2.14.0->datasets[vision]~=2.14.0->autotrain-advanced) (1.9.4)
Requirement already satisfied: async-timeout<5.0,>=4.0 in ./env/lib/python3.10/site-packages (from aiohttp->datasets~=2.14.0->datasets[vision]~=2.14.0->autotrain-advanced) (4.0.3)
Requirement already satisfied: contourpy>=1.0.1 in ./env/lib/python3.10/site-packages (from matplotlib~=3.0->gradio==3.41.0->autotrain-advanced) (1.2.0)
Requirement already satisfied: cycler>=0.10 in ./env/lib/python3.10/site-packages (from matplotlib~=3.0->gradio==3.41.0->autotrain-advanced) (0.12.1)
Requirement already satisfied: fonttools>=4.22.0 in ./env/lib/python3.10/site-packages (from matplotlib~=3.0->gradio==3.41.0->autotrain-advanced) (4.49.0)
Requirement already satisfied: kiwisolver>=1.3.1 in ./env/lib/python3.10/site-packages (from matplotlib~=3.0->gradio==3.41.0->autotrain-advanced) (1.4.5)
Requirement already satisfied: pyparsing>=2.3.1 in ./env/lib/python3.10/site-packages (from matplotlib~=3.0->gradio==3.41.0->autotrain-advanced) (3.1.1)
Requirement already satisfied: networkx>=2.8 in ./env/lib/python3.10/site-packages (from scikit-image>=0.16.1->albumentations==1.3.1->autotrain-advanced) (3.1)
Requirement already satisfied: imageio>=2.27 in ./env/lib/python3.10/site-packages (from scikit-image>=0.16.1->albumentations==1.3.1->autotrain-advanced) (2.34.0)
Requirement already satisfied: tifffile>=2022.8.12 in ./env/lib/python3.10/site-packages (from scikit-image>=0.16.1->albumentations==1.3.1->autotrain-advanced) (2024.2.12)
Requirement already satisfied: lazy_loader>=0.3 in ./env/lib/python3.10/site-packages (from scikit-image>=0.16.1->albumentations==1.3.1->autotrain-advanced) (0.3)
Requirement already satisfied: greenlet!=0.4.17 in ./env/lib/python3.10/site-packages (from sqlalchemy>=1.3.0->optuna==3.3.0->autotrain-advanced) (3.0.3)
Requirement already satisfied: sympy in ./env/lib/python3.10/site-packages (from torch>=1.10.0->accelerate==0.26.1->autotrain-advanced) (1.12)
Requirement already satisfied: docstring-parser>=0.14.1 in ./env/lib/python3.10/site-packages (from tyro>=0.5.11->trl==0.7.11->autotrain-advanced) (0.15)
Requirement already satisfied: rich>=11.1.0 in ./env/lib/python3.10/site-packages (from tyro>=0.5.11->trl==0.7.11->autotrain-advanced) (13.7.0)
Requirement already satisfied: shtab>=1.5.6 in ./env/lib/python3.10/site-packages (from tyro>=0.5.11->trl==0.7.11->autotrain-advanced) (1.6.5)
Requirement already satisfied: types-python-dateutil>=2.8.10 in ./env/lib/python3.10/site-packages (from arrow->codecarbon==2.2.3->autotrain-advanced) (2.8.19.20240106)
Requirement already satisfied: cffi>=1.12 in ./env/lib/python3.10/site-packages (from cryptography->authlib==1.3.0->autotrain-advanced) (1.16.0)
Requirement already satisfied: httpcore==1.* in ./env/lib/python3.10/site-packages (from httpx->gradio==3.41.0->autotrain-advanced) (1.0.3)
Requirement already satisfied: zipp>=0.5 in ./env/lib/python3.10/site-packages (from importlib-metadata->diffusers==0.21.4->autotrain-advanced) (3.17.0)
Requirement already satisfied: pycparser in ./env/lib/python3.10/site-packages (from cffi>=1.12->cryptography->authlib==1.3.0->autotrain-advanced) (2.21)
Requirement already satisfied: jsonschema-specifications>=2023.03.6 in ./env/lib/python3.10/site-packages (from jsonschema>=3.0->altair<6.0,>=4.2.0->gradio==3.41.0->autotrain-advanced) (2023.12.1)
Requirement already satisfied: referencing>=0.28.4 in ./env/lib/python3.10/site-packages (from jsonschema>=3.0->altair<6.0,>=4.2.0->gradio==3.41.0->autotrain-advanced) (0.33.0)
Requirement already satisfied: rpds-py>=0.7.1 in ./env/lib/python3.10/site-packages (from jsonschema>=3.0->altair<6.0,>=4.2.0->gradio==3.41.0->autotrain-advanced) (0.18.0)
Requirement already satisfied: markdown-it-py>=2.2.0 in ./env/lib/python3.10/site-packages (from rich>=11.1.0->tyro>=0.5.11->trl==0.7.11->autotrain-advanced) (3.0.0)
Requirement already satisfied: pygments<3.0.0,>=2.13.0 in ./env/lib/python3.10/site-packages (from rich>=11.1.0->tyro>=0.5.11->trl==0.7.11->autotrain-advanced) (2.17.2)
Requirement already satisfied: mpmath>=0.19 in ./env/lib/python3.10/site-packages (from sympy->torch>=1.10.0->accelerate==0.26.1->autotrain-advanced) (1.3.0)
Requirement already satisfied: mdurl~=0.1 in ./env/lib/python3.10/site-packages (from markdown-it-py>=2.2.0->rich>=11.1.0->tyro>=0.5.11->trl==0.7.11->autotrain-advanced) (0.1.2)
Downloading autotrain_advanced-0.6.93-py3-none-any.whl (226 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 226.5/226.5 kB 15.8 MB/s eta 0:00:00
Installing collected packages: autotrain-advanced
Successfully installed autotrain-advanced-0.6.93
INFO:     Will watch for changes in these directories: ['/app']
WARNING:  "workers" flag is ignored when reloading is enabled.
INFO:     Uvicorn running on http://0.0.0.0:7860 (Press CTRL+C to quit)
INFO:     Started reloader process [34] using StatReload
> WARNING Parameters not supplied by user and set to default: merge_adapter, push_to_hub, valid_split, lr, model_ref, data_path, logging_steps, text_column, username, max_grad_norm, warmup_ratio, train_split, batch_size, lora_alpha, dpo_beta, seed, lora_r, evaluation_strategy, disable_gradient_checkpointing, lora_dropout, repo_id, save_total_limit, gradient_accumulation, prompt_text_column, use_flash_attention_2, trainer, token, apply_chat_template, auto_find_batch_size, add_eos_token, model, model_max_length, optimizer, scheduler, rejected_text_column, save_strategy, weight_decay, project_name
> WARNING Parameters not supplied by user and set to default: save_total_limit, gradient_accumulation, log, push_to_hub, valid_split, lr, data_path, logging_steps, text_column, username, token, max_grad_norm, warmup_ratio, train_split, batch_size, epochs, optimizer, scheduler, model, auto_find_batch_size, max_seq_length, target_column, seed, evaluation_strategy, save_strategy, weight_decay, project_name, repo_id
> WARNING Parameters not supplied by user and set to default: save_total_limit, gradient_accumulation, log, push_to_hub, valid_split, lr, data_path, logging_steps, username, token, max_grad_norm, warmup_ratio, train_split, batch_size, epochs, optimizer, scheduler, model, auto_find_batch_size, image_column, target_column, seed, evaluation_strategy, save_strategy, weight_decay, project_name, repo_id
> WARNING Parameters not supplied by user and set to default: push_to_hub, valid_split, lr, data_path, logging_steps, text_column, username, max_grad_norm, warmup_ratio, train_split, quantization, batch_size, lora_alpha, target_column, seed, lora_r, evaluation_strategy, max_target_length, lora_dropout, save_total_limit, gradient_accumulation, token, epochs, optimizer, scheduler, model, auto_find_batch_size, max_seq_length, peft, target_modules, save_strategy, weight_decay, project_name, repo_id
> WARNING Parameters not supplied by user and set to default: categorical_columns, push_to_hub, valid_split, target_columns, data_path, username, token, train_split, time_limit, model, id_column, seed, numerical_columns, num_trials, project_name, repo_id, task
> WARNING Parameters not supplied by user and set to default: class_prompt, tokenizer, push_to_hub, lr_power, checkpoints_total_limit, validation_images, adam_epsilon, username, adam_weight_decay, max_grad_norm, dataloader_num_workers, checkpointing_steps, class_image_path, center_crop, scale_lr, prior_loss_weight, seed, adam_beta2, bf16, tokenizer_max_length, prior_generation_precision, image_path, rank, validation_prompt, warmup_steps, allow_tf32, class_labels_conditioning, adam_beta1, token, logging, epochs, scheduler, num_validation_images, model, xl, prior_preservation, sample_batch_size, local_rank, validation_epochs, resume_from_checkpoint, pre_compute_text_embeddings, revision, num_cycles, num_class_images, text_encoder_use_attention_mask, project_name, repo_id
> WARNING Parameters not supplied by user and set to default: save_total_limit, gradient_accumulation, log, push_to_hub, valid_split, lr, data_path, logging_steps, tags_column, username, token, max_grad_norm, warmup_ratio, train_split, batch_size, epochs, optimizer, scheduler, model, auto_find_batch_size, max_seq_length, tokens_column, seed, evaluation_strategy, save_strategy, weight_decay, project_name, repo_id
/app/env/lib/python3.10/site-packages/autotrain/oauth.py:102: UserWarning: AutoTrain does not support OAuth features outside of a Space environment. To help you debug your app locally, the login and logout buttons are mocked with your profile. To make it work, your machine must be logged in to Huggingface.
  warnings.warn(
INFO:     Started server process [43]
INFO:     Waiting for application startup.
INFO:     Application startup complete.
> INFO    Authenticating user...
INFO:     10.16.3.18:56732 - "GET /?logs=container&__sign=eyJhbGciOiJFZERTQSJ9.eyJyZWFkIjp0cnVlLCJvbkJlaGFsZk9mIjp7Il9pZCI6IjYyNTY5MDZjNGE3MDQ2ZmQyOTdjOGM3ZSIsInVzZXIiOiJwZ2FicnlzIn0sImlhdCI6MTcwODQ1MTYyNSwic3ViIjoiL3NwYWNlcy9wZ2FicnlzL3BpaXJhdGUiLCJleHAiOjE3MDg1MzgwMjUsImlzcyI6Imh0dHBzOi8vaHVnZ2luZ2ZhY2UuY28ifQ.mt75XbfFFDh1wtQU0LNWnAkG8B8-5LZahXKvZ9aqdhfnc5fJ-Edhpraq0hMtUo1o6u6f1wAdjExCmzHCZhAeCw HTTP/1.1" 200 OK
INFO:     10.16.3.18:56732 - "GET /logo.png HTTP/1.1" 200 OK
> INFO    Task: llm:sft
INFO:     10.16.3.18:56732 - "GET /params/llm%3Asft HTTP/1.1" 200 OK
INFO:     10.16.3.18:56732 - "GET /accelerators HTTP/1.1" 200 OK
INFO:     10.16.3.18:29529 - "GET /model_choices/llm%3Asft HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:3749 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:63277 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.41.118:37334 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.41.118:60479 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:32495 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.41.118:31148 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:60455 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:31306 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Task: token-classification
INFO:     10.16.25.191:58862 - "GET /params/token-classification HTTP/1.1" 200 OK
INFO:     10.16.25.191:44682 - "GET /model_choices/token-classification HTTP/1.1" 200 OK
INFO:     10.16.25.191:44682 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.41.118:37770 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.25.191:1975 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:45961 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.41.118:23888 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:17842 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.25.191:5322 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:38635 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.25.191:45085 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.3.18:10518 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.25.191:37317 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.41.118:51812 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.41.118:30078 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.25.191:23989 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.41.118:2768 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:45299 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.25.191:54952 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.25.191:50196 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.3.18:26355 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.25.191:60655 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.25.191:61700 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.25.191:14141 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.25.191:65235 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:14782 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.25.191:50116 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.25.191:41446 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.25.191:46458 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.25.191:43453 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.41.118:15851 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.41.118:12175 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.3.18:46494 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:46494 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Authenticating user...
INFO:     10.16.41.118:50615 - "GET /?logs=container&__sign=eyJhbGciOiJFZERTQSJ9.eyJyZWFkIjp0cnVlLCJvbkJlaGFsZk9mIjp7Il9pZCI6IjYyNTY5MDZjNGE3MDQ2ZmQyOTdjOGM3ZSIsInVzZXIiOiJwZ2FicnlzIn0sImlhdCI6MTcwODQ1MTYyNSwic3ViIjoiL3NwYWNlcy9wZ2FicnlzL3BpaXJhdGUiLCJleHAiOjE3MDg1MzgwMjUsImlzcyI6Imh0dHBzOi8vaHVnZ2luZ2ZhY2UuY28ifQ.mt75XbfFFDh1wtQU0LNWnAkG8B8-5LZahXKvZ9aqdhfnc5fJ-Edhpraq0hMtUo1o6u6f1wAdjExCmzHCZhAeCw HTTP/1.1" 200 OK
INFO:     10.16.41.118:50615 - "GET /logo.png HTTP/1.1" 200 OK
INFO:     10.16.25.191:29022 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Task: llm:sft
INFO:     10.16.25.191:56588 - "GET /params/llm%3Asft HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.41.118:59974 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.25.191:54217 - "GET /model_choices/llm%3Asft HTTP/1.1" 200 OK
INFO:     10.16.25.191:56588 - "GET /favicon.ico HTTP/1.1" 404 Not Found
> INFO    Running jobs: []
INFO:     10.16.41.118:59974 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.25.191:54217 - "GET /help/params_info HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.41.118:38701 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.3.18:11425 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:1358 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:56857 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.25.191:41648 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.3.18:52257 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.25.191:42102 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.3.18:53243 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.41.118:62142 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:41824 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:12219 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.41.118:62889 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.41.118:26282 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:11496 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.41.118:10049 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.25.191:2328 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:56261 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.41.118:11047 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.41.118:47924 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.25.191:46281 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.3.18:55279 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.41.118:2254 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    hardware: Local
> INFO    Running jobs: []
> INFO    Task: text_token_classification
> INFO    Column mapping: {'text': 'tokens', 'label': 'tags'}
> INFO    Dataset: pii-foundation (text_token_classification)
Train data: [<tempfile.SpooledTemporaryFile object at 0x7f2f23ee0550>]
Valid data: [<tempfile.SpooledTemporaryFile object at 0x7f2f23db65c0>]
Column mapping: {'text': 'tokens', 'label': 'tags'}

Saving the dataset (0/1 shards):   0%|          | 0/17698 [00:00<?, ? examples/s]
Saving the dataset (1/1 shards): 100%|██████████| 17698/17698 [00:00<00:00, 353187.32 examples/s]
Saving the dataset (1/1 shards): 100%|██████████| 17698/17698 [00:00<00:00, 351611.40 examples/s]
Saving the dataset (0/1 shards):   0%|          | 0/6807 [00:00<?, ? examples/s]
Saving the dataset (1/1 shards): 100%|██████████| 6807/6807 [00:00<00:00, 283077.47 examples/s]
Saving the dataset (1/1 shards): 100%|██████████| 6807/6807 [00:00<00:00, 280855.31 examples/s]
INFO:     10.16.41.118:44530 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.25.191:26368 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.41.118:61571 - "POST /create_project HTTP/1.1" 500 Internal Server Error
ERROR:    Exception in ASGI application
Traceback (most recent call last):
  File "/app/env/lib/python3.10/site-packages/uvicorn/protocols/http/h11_impl.py", line 428, in run_asgi
    result = await app(  # type: ignore[func-returns-value]
  File "/app/env/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 78, in __call__
    return await self.app(scope, receive, send)
  File "/app/env/lib/python3.10/site-packages/fastapi/applications.py", line 1106, in __call__
    await super().__call__(scope, receive, send)
  File "/app/env/lib/python3.10/site-packages/starlette/applications.py", line 122, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/app/env/lib/python3.10/site-packages/starlette/middleware/errors.py", line 184, in __call__
    raise exc
  File "/app/env/lib/python3.10/site-packages/starlette/middleware/errors.py", line 162, in __call__
    await self.app(scope, receive, _send)
  File "/app/env/lib/python3.10/site-packages/starlette/middleware/sessions.py", line 86, in __call__
    await self.app(scope, receive, send_wrapper)
  File "/app/env/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 79, in __call__
    raise exc
  File "/app/env/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 68, in __call__
    await self.app(scope, receive, sender)
  File "/app/env/lib/python3.10/site-packages/fastapi/middleware/asyncexitstack.py", line 20, in __call__
    raise e
  File "/app/env/lib/python3.10/site-packages/fastapi/middleware/asyncexitstack.py", line 17, in __call__
    await self.app(scope, receive, send)
  File "/app/env/lib/python3.10/site-packages/starlette/routing.py", line 718, in __call__
    await route.handle(scope, receive, send)
  File "/app/env/lib/python3.10/site-packages/starlette/routing.py", line 276, in handle
    await self.app(scope, receive, send)
  File "/app/env/lib/python3.10/site-packages/starlette/routing.py", line 66, in app
    response = await func(request)
  File "/app/env/lib/python3.10/site-packages/fastapi/routing.py", line 274, in app
    raw_response = await run_endpoint_function(
  File "/app/env/lib/python3.10/site-packages/fastapi/routing.py", line 191, in run_endpoint_function
    return await dependant.call(**values)
  File "/app/env/lib/python3.10/site-packages/autotrain/app.py", line 456, in handle_form
    params = app_params.munge()
  File "/app/env/lib/python3.10/site-packages/autotrain/app_params.py", line 37, in munge
    raise ValueError(f"Unknown task: {self.task}")
ValueError: Unknown task: token-classification
INFO:     10.16.25.191:26368 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.41.118:44530 - "GET /is_model_training HTTP/1.1" 200 OK```

### Additional Information

_No response_
abhishekkrthakur commented 8 months ago

working on it

abhishekkrthakur commented 8 months ago

it should now be fixed. please let me know otherwise

PiotrekGa commented 8 months ago

Nope, another error occurred. I've deleted the old space and created a new one, so the code should be up-to-date.

===== Application Startup at 2024-02-22 20:36:38 =====

==========
== CUDA ==
==========

CUDA Version 12.1.1

Container image Copyright (c) 2016-2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved.

This container image and its contents are governed by the NVIDIA Deep Learning Container License.
By pulling and using the container, you accept the terms and conditions of this license:
https://developer.nvidia.com/ngc/nvidia-deep-learning-container-license

A copy of this license is made available in this container at /NGC-DL-CONTAINER-LICENSE for your convenience.

Found existing installation: autotrain-advanced 0.6.98.dev0
Uninstalling autotrain-advanced-0.6.98.dev0:
  Successfully uninstalled autotrain-advanced-0.6.98.dev0
Collecting autotrain-advanced
  Downloading autotrain_advanced-0.6.97-py3-none-any.whl.metadata (11 kB)
Requirement already satisfied: albumentations==1.3.1 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (1.3.1)
Requirement already satisfied: codecarbon==2.2.3 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (2.2.3)
Requirement already satisfied: datasets~=2.14.0 in ./env/lib/python3.10/site-packages (from datasets[vision]~=2.14.0->autotrain-advanced) (2.14.7)
Requirement already satisfied: evaluate==0.3.0 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.3.0)
Requirement already satisfied: ipadic==1.0.0 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (1.0.0)
Requirement already satisfied: jiwer==3.0.2 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (3.0.2)
Requirement already satisfied: joblib==1.3.1 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (1.3.1)
Requirement already satisfied: loguru==0.7.0 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.7.0)
Requirement already satisfied: pandas>=1.4 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (2.2.0)
Requirement already satisfied: nltk==3.8.1 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (3.8.1)
Requirement already satisfied: optuna==3.3.0 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (3.3.0)
Requirement already satisfied: Pillow==10.0.0 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (10.0.0)
Requirement already satisfied: protobuf==4.23.4 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (4.23.4)
Requirement already satisfied: sacremoses==0.0.53 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.0.53)
Requirement already satisfied: scikit-learn==1.3.0 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (1.3.0)
Requirement already satisfied: sentencepiece==0.1.99 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.1.99)
Requirement already satisfied: tqdm==4.65.0 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (4.65.0)
Requirement already satisfied: werkzeug==2.3.6 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (2.3.6)
Requirement already satisfied: xgboost==1.7.6 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (1.7.6)
Requirement already satisfied: huggingface-hub>=0.16.4 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.20.3)
Requirement already satisfied: requests==2.31.0 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (2.31.0)
Requirement already satisfied: einops==0.6.1 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.6.1)
Requirement already satisfied: invisible-watermark==0.2.0 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.2.0)
Requirement already satisfied: packaging==23.1 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (23.1)
Requirement already satisfied: tensorboard in ./env/lib/python3.10/site-packages (from autotrain-advanced) (2.16.2)
Requirement already satisfied: peft==0.8.2 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.8.2)
Requirement already satisfied: trl==0.7.11 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.7.11)
Requirement already satisfied: tiktoken==0.5.1 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.5.1)
Requirement already satisfied: transformers==4.38.0 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (4.38.0)
Requirement already satisfied: accelerate==0.26.1 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.26.1)
Requirement already satisfied: diffusers==0.21.4 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.21.4)
Requirement already satisfied: bitsandbytes==0.42.0 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.42.0)
Requirement already satisfied: rouge-score==0.1.2 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.1.2)
Requirement already satisfied: py7zr==0.20.6 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.20.6)
Requirement already satisfied: fastapi==0.104.1 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.104.1)
Requirement already satisfied: uvicorn==0.22.0 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.22.0)
Requirement already satisfied: python-multipart==0.0.6 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.0.6)
Requirement already satisfied: gradio==3.41.0 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (3.41.0)
Requirement already satisfied: pydantic==2.4.2 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (2.4.2)
Requirement already satisfied: hf-transfer in ./env/lib/python3.10/site-packages (from autotrain-advanced) (0.1.5)
Requirement already satisfied: pyngrok==7.0.3 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (7.0.3)
Requirement already satisfied: authlib==1.3.0 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (1.3.0)
Requirement already satisfied: itsdangerous==2.1.2 in ./env/lib/python3.10/site-packages (from autotrain-advanced) (2.1.2)
Requirement already satisfied: numpy>=1.17 in ./env/lib/python3.10/site-packages (from accelerate==0.26.1->autotrain-advanced) (1.26.3)
Requirement already satisfied: psutil in ./env/lib/python3.10/site-packages (from accelerate==0.26.1->autotrain-advanced) (5.9.8)
Requirement already satisfied: pyyaml in ./env/lib/python3.10/site-packages (from accelerate==0.26.1->autotrain-advanced) (6.0.1)
Requirement already satisfied: torch>=1.10.0 in ./env/lib/python3.10/site-packages (from accelerate==0.26.1->autotrain-advanced) (2.2.1)
Requirement already satisfied: safetensors>=0.3.1 in ./env/lib/python3.10/site-packages (from accelerate==0.26.1->autotrain-advanced) (0.4.2)
Requirement already satisfied: scipy>=1.1.0 in ./env/lib/python3.10/site-packages (from albumentations==1.3.1->autotrain-advanced) (1.12.0)
Requirement already satisfied: scikit-image>=0.16.1 in ./env/lib/python3.10/site-packages (from albumentations==1.3.1->autotrain-advanced) (0.22.0)
Requirement already satisfied: qudida>=0.0.4 in ./env/lib/python3.10/site-packages (from albumentations==1.3.1->autotrain-advanced) (0.0.4)
Requirement already satisfied: opencv-python-headless>=4.1.1 in ./env/lib/python3.10/site-packages (from albumentations==1.3.1->autotrain-advanced) (4.9.0.80)
Requirement already satisfied: cryptography in ./env/lib/python3.10/site-packages (from authlib==1.3.0->autotrain-advanced) (42.0.4)
Requirement already satisfied: arrow in ./env/lib/python3.10/site-packages (from codecarbon==2.2.3->autotrain-advanced) (1.3.0)
Requirement already satisfied: pynvml in ./env/lib/python3.10/site-packages (from codecarbon==2.2.3->autotrain-advanced) (11.5.0)
Requirement already satisfied: py-cpuinfo in ./env/lib/python3.10/site-packages (from codecarbon==2.2.3->autotrain-advanced) (9.0.0)
Requirement already satisfied: fuzzywuzzy in ./env/lib/python3.10/site-packages (from codecarbon==2.2.3->autotrain-advanced) (0.18.0)
Requirement already satisfied: click in ./env/lib/python3.10/site-packages (from codecarbon==2.2.3->autotrain-advanced) (8.1.7)
Requirement already satisfied: filelock in ./env/lib/python3.10/site-packages (from diffusers==0.21.4->autotrain-advanced) (3.13.1)
Requirement already satisfied: importlib-metadata in ./env/lib/python3.10/site-packages (from diffusers==0.21.4->autotrain-advanced) (7.0.1)
Requirement already satisfied: regex!=2019.12.17 in ./env/lib/python3.10/site-packages (from diffusers==0.21.4->autotrain-advanced) (2023.12.25)
Requirement already satisfied: dill in ./env/lib/python3.10/site-packages (from evaluate==0.3.0->autotrain-advanced) (0.3.7)
Requirement already satisfied: xxhash in ./env/lib/python3.10/site-packages (from evaluate==0.3.0->autotrain-advanced) (3.4.1)
Requirement already satisfied: multiprocess in ./env/lib/python3.10/site-packages (from evaluate==0.3.0->autotrain-advanced) (0.70.15)
Requirement already satisfied: fsspec>=2021.05.0 in ./env/lib/python3.10/site-packages (from fsspec[http]>=2021.05.0->evaluate==0.3.0->autotrain-advanced) (2023.10.0)
Requirement already satisfied: responses<0.19 in ./env/lib/python3.10/site-packages (from evaluate==0.3.0->autotrain-advanced) (0.18.0)
Requirement already satisfied: anyio<4.0.0,>=3.7.1 in ./env/lib/python3.10/site-packages (from fastapi==0.104.1->autotrain-advanced) (3.7.1)
Requirement already satisfied: starlette<0.28.0,>=0.27.0 in ./env/lib/python3.10/site-packages (from fastapi==0.104.1->autotrain-advanced) (0.27.0)
Requirement already satisfied: typing-extensions>=4.8.0 in ./env/lib/python3.10/site-packages (from fastapi==0.104.1->autotrain-advanced) (4.9.0)
Requirement already satisfied: aiofiles<24.0,>=22.0 in ./env/lib/python3.10/site-packages (from gradio==3.41.0->autotrain-advanced) (23.2.1)
Requirement already satisfied: altair<6.0,>=4.2.0 in ./env/lib/python3.10/site-packages (from gradio==3.41.0->autotrain-advanced) (5.2.0)
Requirement already satisfied: ffmpy in ./env/lib/python3.10/site-packages (from gradio==3.41.0->autotrain-advanced) (0.3.2)
Requirement already satisfied: gradio-client==0.5.0 in ./env/lib/python3.10/site-packages (from gradio==3.41.0->autotrain-advanced) (0.5.0)
Requirement already satisfied: httpx in ./env/lib/python3.10/site-packages (from gradio==3.41.0->autotrain-advanced) (0.27.0)
Requirement already satisfied: importlib-resources<7.0,>=1.3 in ./env/lib/python3.10/site-packages (from gradio==3.41.0->autotrain-advanced) (6.1.1)
Requirement already satisfied: jinja2<4.0 in ./env/lib/python3.10/site-packages (from gradio==3.41.0->autotrain-advanced) (3.1.3)
Requirement already satisfied: markupsafe~=2.0 in ./env/lib/python3.10/site-packages (from gradio==3.41.0->autotrain-advanced) (2.1.3)
Requirement already satisfied: matplotlib~=3.0 in ./env/lib/python3.10/site-packages (from gradio==3.41.0->autotrain-advanced) (3.8.3)
Requirement already satisfied: orjson~=3.0 in ./env/lib/python3.10/site-packages (from gradio==3.41.0->autotrain-advanced) (3.9.14)
Requirement already satisfied: pydub in ./env/lib/python3.10/site-packages (from gradio==3.41.0->autotrain-advanced) (0.25.1)
Requirement already satisfied: semantic-version~=2.0 in ./env/lib/python3.10/site-packages (from gradio==3.41.0->autotrain-advanced) (2.10.0)
Requirement already satisfied: websockets<12.0,>=10.0 in ./env/lib/python3.10/site-packages (from gradio==3.41.0->autotrain-advanced) (11.0.3)
Requirement already satisfied: PyWavelets>=1.1.1 in ./env/lib/python3.10/site-packages (from invisible-watermark==0.2.0->autotrain-advanced) (1.5.0)
Requirement already satisfied: opencv-python>=4.1.0.25 in ./env/lib/python3.10/site-packages (from invisible-watermark==0.2.0->autotrain-advanced) (4.9.0.80)
Requirement already satisfied: rapidfuzz==2.13.7 in ./env/lib/python3.10/site-packages (from jiwer==3.0.2->autotrain-advanced) (2.13.7)
Requirement already satisfied: alembic>=1.5.0 in ./env/lib/python3.10/site-packages (from optuna==3.3.0->autotrain-advanced) (1.13.1)
Requirement already satisfied: cmaes>=0.10.0 in ./env/lib/python3.10/site-packages (from optuna==3.3.0->autotrain-advanced) (0.10.0)
Requirement already satisfied: colorlog in ./env/lib/python3.10/site-packages (from optuna==3.3.0->autotrain-advanced) (6.8.2)
Requirement already satisfied: sqlalchemy>=1.3.0 in ./env/lib/python3.10/site-packages (from optuna==3.3.0->autotrain-advanced) (2.0.27)
Requirement already satisfied: texttable in ./env/lib/python3.10/site-packages (from py7zr==0.20.6->autotrain-advanced) (1.7.0)
Requirement already satisfied: pycryptodomex>=3.6.6 in ./env/lib/python3.10/site-packages (from py7zr==0.20.6->autotrain-advanced) (3.20.0)
Requirement already satisfied: pyzstd>=0.14.4 in ./env/lib/python3.10/site-packages (from py7zr==0.20.6->autotrain-advanced) (0.15.9)
Requirement already satisfied: pyppmd<1.1.0,>=0.18.1 in ./env/lib/python3.10/site-packages (from py7zr==0.20.6->autotrain-advanced) (1.0.0)
Requirement already satisfied: pybcj>=0.6.0 in ./env/lib/python3.10/site-packages (from py7zr==0.20.6->autotrain-advanced) (1.0.2)
Requirement already satisfied: multivolumefile>=0.2.3 in ./env/lib/python3.10/site-packages (from py7zr==0.20.6->autotrain-advanced) (0.2.3)
Requirement already satisfied: brotli>=1.0.9 in ./env/lib/python3.10/site-packages (from py7zr==0.20.6->autotrain-advanced) (1.0.9)
Requirement already satisfied: inflate64>=0.3.1 in ./env/lib/python3.10/site-packages (from py7zr==0.20.6->autotrain-advanced) (1.0.0)
Requirement already satisfied: annotated-types>=0.4.0 in ./env/lib/python3.10/site-packages (from pydantic==2.4.2->autotrain-advanced) (0.6.0)
Requirement already satisfied: pydantic-core==2.10.1 in ./env/lib/python3.10/site-packages (from pydantic==2.4.2->autotrain-advanced) (2.10.1)
Requirement already satisfied: charset-normalizer<4,>=2 in ./env/lib/python3.10/site-packages (from requests==2.31.0->autotrain-advanced) (2.0.4)
Requirement already satisfied: idna<4,>=2.5 in ./env/lib/python3.10/site-packages (from requests==2.31.0->autotrain-advanced) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in ./env/lib/python3.10/site-packages (from requests==2.31.0->autotrain-advanced) (2.1.0)
Requirement already satisfied: certifi>=2017.4.17 in ./env/lib/python3.10/site-packages (from requests==2.31.0->autotrain-advanced) (2024.2.2)
Requirement already satisfied: absl-py in ./env/lib/python3.10/site-packages (from rouge-score==0.1.2->autotrain-advanced) (2.1.0)
Requirement already satisfied: six>=1.14.0 in ./env/lib/python3.10/site-packages (from rouge-score==0.1.2->autotrain-advanced) (1.16.0)
Requirement already satisfied: threadpoolctl>=2.0.0 in ./env/lib/python3.10/site-packages (from scikit-learn==1.3.0->autotrain-advanced) (3.3.0)
Requirement already satisfied: tokenizers<0.19,>=0.14 in ./env/lib/python3.10/site-packages (from transformers==4.38.0->autotrain-advanced) (0.15.2)
Requirement already satisfied: tyro>=0.5.11 in ./env/lib/python3.10/site-packages (from trl==0.7.11->autotrain-advanced) (0.7.3)
Requirement already satisfied: h11>=0.8 in ./env/lib/python3.10/site-packages (from uvicorn==0.22.0->autotrain-advanced) (0.14.0)
Requirement already satisfied: pyarrow>=8.0.0 in ./env/lib/python3.10/site-packages (from datasets~=2.14.0->datasets[vision]~=2.14.0->autotrain-advanced) (15.0.0)
Requirement already satisfied: pyarrow-hotfix in ./env/lib/python3.10/site-packages (from datasets~=2.14.0->datasets[vision]~=2.14.0->autotrain-advanced) (0.6)
Requirement already satisfied: aiohttp in ./env/lib/python3.10/site-packages (from datasets~=2.14.0->datasets[vision]~=2.14.0->autotrain-advanced) (3.9.3)
Requirement already satisfied: python-dateutil>=2.8.2 in ./env/lib/python3.10/site-packages (from pandas>=1.4->autotrain-advanced) (2.8.2)
Requirement already satisfied: pytz>=2020.1 in ./env/lib/python3.10/site-packages (from pandas>=1.4->autotrain-advanced) (2024.1)
Requirement already satisfied: tzdata>=2022.7 in ./env/lib/python3.10/site-packages (from pandas>=1.4->autotrain-advanced) (2024.1)
Requirement already satisfied: grpcio>=1.48.2 in ./env/lib/python3.10/site-packages (from tensorboard->autotrain-advanced) (1.62.0)
Requirement already satisfied: markdown>=2.6.8 in ./env/lib/python3.10/site-packages (from tensorboard->autotrain-advanced) (3.5.2)
Requirement already satisfied: setuptools>=41.0.0 in ./env/lib/python3.10/site-packages (from tensorboard->autotrain-advanced) (68.2.2)
Requirement already satisfied: tensorboard-data-server<0.8.0,>=0.7.0 in ./env/lib/python3.10/site-packages (from tensorboard->autotrain-advanced) (0.7.2)
Requirement already satisfied: Mako in ./env/lib/python3.10/site-packages (from alembic>=1.5.0->optuna==3.3.0->autotrain-advanced) (1.3.2)
Requirement already satisfied: jsonschema>=3.0 in ./env/lib/python3.10/site-packages (from altair<6.0,>=4.2.0->gradio==3.41.0->autotrain-advanced) (4.21.1)
Requirement already satisfied: toolz in ./env/lib/python3.10/site-packages (from altair<6.0,>=4.2.0->gradio==3.41.0->autotrain-advanced) (0.12.1)
Requirement already satisfied: sniffio>=1.1 in ./env/lib/python3.10/site-packages (from anyio<4.0.0,>=3.7.1->fastapi==0.104.1->autotrain-advanced) (1.3.0)
Requirement already satisfied: exceptiongroup in ./env/lib/python3.10/site-packages (from anyio<4.0.0,>=3.7.1->fastapi==0.104.1->autotrain-advanced) (1.2.0)
Requirement already satisfied: aiosignal>=1.1.2 in ./env/lib/python3.10/site-packages (from aiohttp->datasets~=2.14.0->datasets[vision]~=2.14.0->autotrain-advanced) (1.3.1)
Requirement already satisfied: attrs>=17.3.0 in ./env/lib/python3.10/site-packages (from aiohttp->datasets~=2.14.0->datasets[vision]~=2.14.0->autotrain-advanced) (23.2.0)
Requirement already satisfied: frozenlist>=1.1.1 in ./env/lib/python3.10/site-packages (from aiohttp->datasets~=2.14.0->datasets[vision]~=2.14.0->autotrain-advanced) (1.4.1)
Requirement already satisfied: multidict<7.0,>=4.5 in ./env/lib/python3.10/site-packages (from aiohttp->datasets~=2.14.0->datasets[vision]~=2.14.0->autotrain-advanced) (6.0.5)
Requirement already satisfied: yarl<2.0,>=1.0 in ./env/lib/python3.10/site-packages (from aiohttp->datasets~=2.14.0->datasets[vision]~=2.14.0->autotrain-advanced) (1.9.4)
Requirement already satisfied: async-timeout<5.0,>=4.0 in ./env/lib/python3.10/site-packages (from aiohttp->datasets~=2.14.0->datasets[vision]~=2.14.0->autotrain-advanced) (4.0.3)
Requirement already satisfied: contourpy>=1.0.1 in ./env/lib/python3.10/site-packages (from matplotlib~=3.0->gradio==3.41.0->autotrain-advanced) (1.2.0)
Requirement already satisfied: cycler>=0.10 in ./env/lib/python3.10/site-packages (from matplotlib~=3.0->gradio==3.41.0->autotrain-advanced) (0.12.1)
Requirement already satisfied: fonttools>=4.22.0 in ./env/lib/python3.10/site-packages (from matplotlib~=3.0->gradio==3.41.0->autotrain-advanced) (4.49.0)
Requirement already satisfied: kiwisolver>=1.3.1 in ./env/lib/python3.10/site-packages (from matplotlib~=3.0->gradio==3.41.0->autotrain-advanced) (1.4.5)
Requirement already satisfied: pyparsing>=2.3.1 in ./env/lib/python3.10/site-packages (from matplotlib~=3.0->gradio==3.41.0->autotrain-advanced) (3.1.1)
Requirement already satisfied: networkx>=2.8 in ./env/lib/python3.10/site-packages (from scikit-image>=0.16.1->albumentations==1.3.1->autotrain-advanced) (3.1)
Requirement already satisfied: imageio>=2.27 in ./env/lib/python3.10/site-packages (from scikit-image>=0.16.1->albumentations==1.3.1->autotrain-advanced) (2.34.0)
Requirement already satisfied: tifffile>=2022.8.12 in ./env/lib/python3.10/site-packages (from scikit-image>=0.16.1->albumentations==1.3.1->autotrain-advanced) (2024.2.12)
Requirement already satisfied: lazy_loader>=0.3 in ./env/lib/python3.10/site-packages (from scikit-image>=0.16.1->albumentations==1.3.1->autotrain-advanced) (0.3)
Requirement already satisfied: greenlet!=0.4.17 in ./env/lib/python3.10/site-packages (from sqlalchemy>=1.3.0->optuna==3.3.0->autotrain-advanced) (3.0.3)
Requirement already satisfied: sympy in ./env/lib/python3.10/site-packages (from torch>=1.10.0->accelerate==0.26.1->autotrain-advanced) (1.12)
Requirement already satisfied: docstring-parser>=0.14.1 in ./env/lib/python3.10/site-packages (from tyro>=0.5.11->trl==0.7.11->autotrain-advanced) (0.15)
Requirement already satisfied: rich>=11.1.0 in ./env/lib/python3.10/site-packages (from tyro>=0.5.11->trl==0.7.11->autotrain-advanced) (13.7.0)
Requirement already satisfied: shtab>=1.5.6 in ./env/lib/python3.10/site-packages (from tyro>=0.5.11->trl==0.7.11->autotrain-advanced) (1.7.0)
Requirement already satisfied: types-python-dateutil>=2.8.10 in ./env/lib/python3.10/site-packages (from arrow->codecarbon==2.2.3->autotrain-advanced) (2.8.19.20240106)
Requirement already satisfied: cffi>=1.12 in ./env/lib/python3.10/site-packages (from cryptography->authlib==1.3.0->autotrain-advanced) (1.16.0)
Requirement already satisfied: httpcore==1.* in ./env/lib/python3.10/site-packages (from httpx->gradio==3.41.0->autotrain-advanced) (1.0.4)
Requirement already satisfied: zipp>=0.5 in ./env/lib/python3.10/site-packages (from importlib-metadata->diffusers==0.21.4->autotrain-advanced) (3.17.0)
Requirement already satisfied: pycparser in ./env/lib/python3.10/site-packages (from cffi>=1.12->cryptography->authlib==1.3.0->autotrain-advanced) (2.21)
Requirement already satisfied: jsonschema-specifications>=2023.03.6 in ./env/lib/python3.10/site-packages (from jsonschema>=3.0->altair<6.0,>=4.2.0->gradio==3.41.0->autotrain-advanced) (2023.12.1)
Requirement already satisfied: referencing>=0.28.4 in ./env/lib/python3.10/site-packages (from jsonschema>=3.0->altair<6.0,>=4.2.0->gradio==3.41.0->autotrain-advanced) (0.33.0)
Requirement already satisfied: rpds-py>=0.7.1 in ./env/lib/python3.10/site-packages (from jsonschema>=3.0->altair<6.0,>=4.2.0->gradio==3.41.0->autotrain-advanced) (0.18.0)
Requirement already satisfied: markdown-it-py>=2.2.0 in ./env/lib/python3.10/site-packages (from rich>=11.1.0->tyro>=0.5.11->trl==0.7.11->autotrain-advanced) (3.0.0)
Requirement already satisfied: pygments<3.0.0,>=2.13.0 in ./env/lib/python3.10/site-packages (from rich>=11.1.0->tyro>=0.5.11->trl==0.7.11->autotrain-advanced) (2.17.2)
Requirement already satisfied: mpmath>=0.19 in ./env/lib/python3.10/site-packages (from sympy->torch>=1.10.0->accelerate==0.26.1->autotrain-advanced) (1.3.0)
Requirement already satisfied: mdurl~=0.1 in ./env/lib/python3.10/site-packages (from markdown-it-py>=2.2.0->rich>=11.1.0->tyro>=0.5.11->trl==0.7.11->autotrain-advanced) (0.1.2)
Downloading autotrain_advanced-0.6.97-py3-none-any.whl (227 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 227.2/227.2 kB 14.8 MB/s eta 0:00:00
Installing collected packages: autotrain-advanced
Successfully installed autotrain-advanced-0.6.97
INFO:     Will watch for changes in these directories: ['/app']
WARNING:  "workers" flag is ignored when reloading is enabled.
INFO:     Uvicorn running on http://0.0.0.0:7860 (Press CTRL+C to quit)
INFO:     Started reloader process [34] using StatReload
> WARNING Parameters not supplied by user and set to default: use_flash_attention_2, valid_split, username, gradient_accumulation, evaluation_strategy, dpo_beta, lora_alpha, warmup_ratio, optimizer, batch_size, repo_id, merge_adapter, token, model, train_split, trainer, save_total_limit, seed, text_column, logging_steps, prompt_text_column, lora_r, lr, lora_dropout, rejected_text_column, model_ref, auto_find_batch_size, disable_gradient_checkpointing, project_name, model_max_length, save_strategy, push_to_hub, weight_decay, max_grad_norm, add_eos_token, scheduler, data_path
> WARNING Parameters not supplied by user and set to default: lr, valid_split, username, epochs, gradient_accumulation, evaluation_strategy, max_seq_length, target_column, auto_find_batch_size, project_name, optimizer, warmup_ratio, batch_size, repo_id, save_strategy, token, push_to_hub, weight_decay, model, train_split, max_grad_norm, save_total_limit, seed, log, scheduler, text_column, logging_steps, data_path
> WARNING Parameters not supplied by user and set to default: lr, username, valid_split, epochs, gradient_accumulation, evaluation_strategy, target_column, auto_find_batch_size, project_name, optimizer, warmup_ratio, batch_size, repo_id, save_strategy, token, push_to_hub, weight_decay, model, train_split, max_grad_norm, save_total_limit, image_column, seed, log, scheduler, logging_steps, data_path
> WARNING Parameters supplied but not used: target_modules
> WARNING Parameters not supplied by user and set to default: username, valid_split, gradient_accumulation, evaluation_strategy, lora_alpha, target_column, max_seq_length, warmup_ratio, optimizer, batch_size, repo_id, token, model, train_split, save_total_limit, peft, seed, logging_steps, lora_r, lr, lora_dropout, epochs, max_target_length, auto_find_batch_size, project_name, quantization, save_strategy, target_modules, push_to_hub, weight_decay, max_grad_norm, scheduler, data_path, text_column
> WARNING Parameters not supplied by user and set to default: username, valid_split, categorical_columns, target_columns, project_name, time_limit, repo_id, numerical_columns, token, task, push_to_hub, model, train_split, num_trials, seed, id_column, data_path
> WARNING Parameters not supplied by user and set to default: username, xl, warmup_steps, local_rank, adam_beta1, pre_compute_text_embeddings, validation_epochs, repo_id, prior_generation_precision, num_validation_images, adam_epsilon, token, model, checkpoints_total_limit, sample_batch_size, lr_power, class_prompt, seed, center_crop, num_cycles, validation_images, logging, validation_prompt, adam_beta2, adam_weight_decay, epochs, checkpointing_steps, revision, dataloader_num_workers, num_class_images, tokenizer, prior_preservation, resume_from_checkpoint, project_name, allow_tf32, tokenizer_max_length, prior_loss_weight, text_encoder_use_attention_mask, push_to_hub, scale_lr, max_grad_norm, class_image_path, bf16, class_labels_conditioning, rank, scheduler, image_path
> WARNING Parameters not supplied by user and set to default: lr, valid_split, username, epochs, gradient_accumulation, evaluation_strategy, max_seq_length, auto_find_batch_size, project_name, optimizer, warmup_ratio, batch_size, tags_column, repo_id, save_strategy, tokens_column, token, push_to_hub, weight_decay, model, train_split, max_grad_norm, save_total_limit, seed, log, scheduler, logging_steps, data_path
/app/env/lib/python3.10/site-packages/autotrain/oauth.py:102: UserWarning: AutoTrain does not support OAuth features outside of a Space environment. To help you debug your app locally, the login and logout buttons are mocked with your profile. To make it work, your machine must be logged in to Huggingface.
  warnings.warn(
INFO:     Started server process [43]
INFO:     Waiting for application startup.
INFO:     Application startup complete.
> INFO    Authenticating user...
INFO:     10.16.25.191:46372 - "GET /?__sign=eyJhbGciOiJFZERTQSJ9.eyJyZWFkIjp0cnVlLCJvbkJlaGFsZk9mIjp7Il9pZCI6IjYyNTY5MDZjNGE3MDQ2ZmQyOTdjOGM3ZSIsInVzZXIiOiJwZ2FicnlzIn0sImlhdCI6MTcwODYzNDM2OCwic3ViIjoiL3NwYWNlcy9wZ2FicnlzL2F1dG90cmFpbiIsImV4cCI6MTcwODcyMDc2OCwiaXNzIjoiaHR0cHM6Ly9odWdnaW5nZmFjZS5jbyJ9.ysF_lqVOONt_YkRrw4pnYsuhvtrRKYRmsJxrVlyTEHu45nGczqcL04MN6_A_EFugxyI-BK4O5yuN6z2TiQxRAw HTTP/1.1" 200 OK
INFO:     10.16.41.118:45075 - "GET /logo.png HTTP/1.1" 200 OK
INFO:     10.16.3.18:5491 - "GET /model_choices/llm%3Asft HTTP/1.1" 200 OK
INFO:     10.16.25.191:46372 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Task: llm:sft
INFO:     10.16.41.118:45075 - "GET /params/llm%3Asft HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:22121 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:37795 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Task: token-classification
INFO:     10.16.25.191:24467 - "GET /params/token-classification HTTP/1.1" 200 OK
INFO:     10.16.25.191:22819 - "GET /model_choices/token-classification HTTP/1.1" 200 OK
INFO:     10.16.25.191:22819 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:26917 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.25.191:7297 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.3.18:30062 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:64908 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:18947 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.3.18:56636 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.25.191:54076 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:61672 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.3.18:58661 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:28296 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:21406 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.3.18:30241 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.25.191:43672 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:27092 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.3.18:5707 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.25.191:25973 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:3538 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.25.191:17088 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.41.118:56227 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:13101 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.3.18:54411 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.25.191:14839 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.25.191:54377 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:14171 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.25.191:20669 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:8278 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.25.191:29158 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.25.191:29158 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:18933 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.25.191:58491 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.41.118:40956 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.25.191:19722 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.3.18:42198 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.41.118:10587 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:6618 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:8519 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.25.191:54763 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.41.118:25137 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:28601 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.25.191:59617 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.41.118:34399 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.25.191:52584 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.41.118:51139 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:24745 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.3.18:39956 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:39956 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:40396 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:42048 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.41.118:23088 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.25.191:23794 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.25.191:22626 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.25.191:57258 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.25.191:25999 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.3.18:12909 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.25.191:54720 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:21587 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.25.191:39256 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.25.191:55384 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:5406 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:2488 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.41.118:53199 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:19976 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:52499 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.41.118:26140 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.25.191:1424 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.25.191:1842 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.41.118:56904 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.25.191:33389 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:39776 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.3.18:28621 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:30063 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:40207 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.25.191:63752 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.25.191:17276 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    hardware: Local
> INFO    Running jobs: []
> INFO    Task: text_token_classification
> INFO    Column mapping: {'text': 'tokens', 'label': 'tags'}
> INFO    Dataset: autotrain-5lq4s-cwkfn (text_token_classification)
Train data: [<tempfile.SpooledTemporaryFile object at 0x7f3f63f78d00>]
Valid data: [<tempfile.SpooledTemporaryFile object at 0x7f3f63f78520>]
Column mapping: {'text': 'tokens', 'label': 'tags'}

Saving the dataset (0/1 shards):   0%|          | 0/17698 [00:00<?, ? examples/s]
Saving the dataset (1/1 shards): 100%|██████████| 17698/17698 [00:00<00:00, 449940.85 examples/s]
Saving the dataset (1/1 shards): 100%|██████████| 17698/17698 [00:00<00:00, 447820.90 examples/s]
Saving the dataset (0/1 shards):   0%|          | 0/6807 [00:00<?, ? examples/s]
Saving the dataset (1/1 shards): 100%|██████████| 6807/6807 [00:00<00:00, 304140.99 examples/s]
Saving the dataset (1/1 shards): 100%|██████████| 6807/6807 [00:00<00:00, 301182.84 examples/s]
> WARNING Parameters not supplied by user and set to default: log, train_split
> WARNING Parameters supplied but not used: target_column, text_column
> INFO    Starting local training...
> INFO    {"data_path":"autotrain-5lq4s-cwkfn/autotrain-data","model":"microsoft/deberta-v3-large","lr":0.00005,"epochs":3,"max_seq_length":128,"batch_size":8,"warmup_ratio":0.1,"gradient_accumulation":1,"optimizer":"adamw_torch","scheduler":"linear","weight_decay":0.0,"max_grad_norm":1.0,"seed":42,"train_split":"train","valid_split":"validation","tokens_column":"tokens","tags_column":"tags","logging_steps":-1,"project_name":"autotrain-5lq4s-cwkfn","auto_find_batch_size":false,"mixed_precision":"fp16","save_total_limit":1,"save_strategy":"epoch","token":"hf_**********************************","push_to_hub":true,"repo_id":"pgabrys/autotrain-5lq4s-cwkfn","evaluation_strategy":"epoch","username":"pgabrys","log":"none"}
> INFO    ['accelerate', 'launch', '--num_machines', '1', '--num_processes', '1', '--mixed_precision', 'fp16', '-m', 'autotrain.trainers.token_classification', '--training_config', 'autotrain-5lq4s-cwkfn/training_params.json']
> INFO    Training PID: 57
INFO:     10.16.41.118:33369 - "POST /create_project HTTP/1.1" 200 OK
INFO:     10.16.3.18:33752 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: [57]
INFO:     10.16.41.118:62331 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.3.18:33752 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: [57]
INFO:     10.16.41.118:62331 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: [57]
INFO:     10.16.3.18:33752 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: [57]
INFO:     10.16.3.18:55125 - "GET /is_model_training HTTP/1.1" 200 OK
The following values were not passed to `accelerate launch` and had defaults used instead:
    `--dynamo_backend` was set to a value of `'no'`
To avoid this warning pass in values for each of the problematic parameters or run `accelerate config`.
> INFO    Running jobs: [57]
INFO:     10.16.41.118:62331 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.25.191:33824 - "GET /accelerators HTTP/1.1" 200 OK
/app/env/lib/python3.10/site-packages/autotrain/trainers/token_classification/utils.py:5: FutureWarning: load_metric is deprecated and will be removed in the next major version of datasets. Use 'evaluate.load' instead, from the new library 🤗 Evaluate: https://huggingface.co/docs/evaluate
  _METRICS = load_metric("seqeval")
Downloading builder script:   0%|          | 0.00/2.47k [00:00<?, ?B/s]
Downloading builder script: 6.33kB [00:00, 20.8MB/s]                   
Traceback (most recent call last):
  File "/app/env/lib/python3.10/runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/app/env/lib/python3.10/runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "/app/env/lib/python3.10/site-packages/autotrain/trainers/token_classification/__main__.py", line 19, in <module>
    from autotrain.trainers.token_classification import utils
  File "/app/env/lib/python3.10/site-packages/autotrain/trainers/token_classification/utils.py", line 5, in <module>
    _METRICS = load_metric("seqeval")
  File "/app/env/lib/python3.10/site-packages/datasets/utils/deprecation_utils.py", line 46, in wrapper
    return deprecated_function(*args, **kwargs)
  File "/app/env/lib/python3.10/site-packages/datasets/load.py", line 1678, in load_metric
    metric_module = metric_module_factory(
  File "/app/env/lib/python3.10/site-packages/datasets/utils/deprecation_utils.py", line 46, in wrapper
    return deprecated_function(*args, **kwargs)
  File "/app/env/lib/python3.10/site-packages/datasets/load.py", line 1609, in metric_module_factory
    raise e1 from None
  File "/app/env/lib/python3.10/site-packages/datasets/load.py", line 1601, in metric_module_factory
    ).get_module()
  File "/app/env/lib/python3.10/site-packages/datasets/load.py", line 706, in get_module
    local_imports = _download_additional_modules(
  File "/app/env/lib/python3.10/site-packages/datasets/load.py", line 294, in _download_additional_modules
    raise ImportError(
ImportError: To be able to use seqeval, you need to install the following dependency: seqeval.
Please install it using 'pip install seqeval' for instance.
Traceback (most recent call last):
  File "/app/env/bin/accelerate", line 8, in <module>
    sys.exit(main())
  File "/app/env/lib/python3.10/site-packages/accelerate/commands/accelerate_cli.py", line 47, in main
    args.func(args)
  File "/app/env/lib/python3.10/site-packages/accelerate/commands/launch.py", line 1023, in launch_command
    simple_launcher(args)
  File "/app/env/lib/python3.10/site-packages/accelerate/commands/launch.py", line 643, in simple_launcher
    raise subprocess.CalledProcessError(returncode=process.returncode, cmd=cmd)
subprocess.CalledProcessError: Command '['/app/env/bin/python', '-m', 'autotrain.trainers.token_classification', '--training_config', 'autotrain-5lq4s-cwkfn/training_params.json']' returned non-zero exit status 1.
> INFO    Running jobs: [57]
> INFO    Killing PID: 57
INFO:     10.16.25.191:57059 - "GET /is_model_training HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:40980 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.25.191:58452 - "GET /accelerators HTTP/1.1" 200 OK
> INFO    Running jobs: []
INFO:     10.16.3.18:57931 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     10.16.3.18:47609 - "GET /accelerators HTTP/1.1" 200 OK
abhishekkrthakur commented 8 months ago

this is a major overlook on my part. apologies. fixed. fix is being deployed. please factory rebuild and try after ~25mins.