wpfl-dbt commented 7 months ago

Core commands for running this, docker compose up and make run, will very quickly run into "no space left on device". I appreciate I can (and have) pruned, but docker has a pretty chunky 64Gb available to it. I suspect the memory footprint of this is much larger than you expect?

Desktop:

OS: macOS 14.4.1 (23E224)

gecBurton commented 7 months ago

have you pruned everything https://github.com/i-dot-ai/redbox-copilot?tab=readme-ov-file#error-elasticsearch-137 8gb should be sufficient to run all the services

Also, here are a lot of services, do you need to run all of them?

wpfl-dbt commented 7 months ago

Done. Had 64Gb free, and 40 mins later it's eaten it all. Looking at the build logs embedder, ingester, core-api, streamlit-app and redbox have some very sus poetry install processes going on, with nvidia libs being installed over and over.

On services -- you tell me what I need! The readme says to use make run which uses most of the below, but I don't see an obvious entrypoint for redbox itself. localhost:8090 has a Django app with no clear way into anything else.

Here's the build logs of the offending services:

embedder

```markdown [internal] load build definition from Dockerfile transferring 916/0 0.005 [internal] load metadata for docker.io/library/python:3.11-slim-buster [internal] load metadata for docker.io/library/python:3.11-buster [internal] load .dockerignore [builder 1/6] FROM docker.io/library/python:3.11-buster@sha256:3a19b4d6ce4402d11bb19aa11416e4a262a60a57707a5cda5787a81285df2666 resolve docker.io/library/python:3.11-buster@sha256:3a19b4d6ce4402d11bb19aa11416e4a262a60a57707a5cda5787a81285df2666 0/0 0.024 done 988/988 -0.345 done 2007/2007 -0.234 done 7522/7522 -0.073 done 17579218/17579218 77.3 done 50448512/50448512 88.973 done 6147835/6147835 99.867 done 51870721/51870721 103.847 done 244/244 104.012 done 3089898/3089898 106.163 done 22309962/22309962 113.162 done 191876389/191876389 153.408 extract 0/0 3.868 extract 0/0 0.804 extract 0/0 4.02 extract 0/0 10.038 extract 0/0 0.427 extract 0/0 0.986 extract 0/0 0 extract 0/0 0.414 [runtime 1/8] FROM docker.io/library/python:3.11-slim-buster@sha256:c46b0ae5728c2247b99903098ade3176a58e274d9c7d2efeaaab3e0621a53935 resolve docker.io/library/python:3.11-slim-buster@sha256:c46b0ae5728c2247b99903098ade3176a58e274d9c7d2efeaaab3e0621a53935 0/0 0.023 done 988/988 -0.412 done 1370/1370 -0.288 done 6834/6834 -0.116 done 27138450/27138450 53.333 done 2781342/2781342 53.691 done 244/244 53.832 done 3380069/3380069 55.495 done 11996761/11996761 58.553 extract 0/0 2.513 extract 0/0 0.221 extract 0/0 0.75 extract 0/0 0 extract 0/0 0.441 [internal] load build context transferring 826641/0 0.062 [builder 2/6] RUN pip install poetry Collecting poetry Downloading poetry-1.8.2-py3-none-any.whl (249 kB) âââââââââââââââââââââââââââââââââââââ 249.4/249.4 kB 303.7 kB/s eta 0:00:00 Collecting build<2.0.0,>=1.0.3 (from poetry) Downloading build-1.2.1-py3-none-any.whl (21 kB) Collecting cachecontrol[filecache]<0.15.0,>=0.14.0 (from poetry) Downloading cachecontrol-0.14.0-py3-none-any.whl (22 kB) Collecting cleo<3.0.0,>=2.1.0 (from poetry) Downloading cleo-2.1.0-py3-none-any.whl (78 kB) ââââââââââââââââââââââââââââââââââââââââ 78.7/78.7 kB 1.8 MB/s eta 0:00:00 Collecting crashtest<0.5.0,>=0.4.1 (from poetry) Downloading crashtest-0.4.1-py3-none-any.whl (7.6 kB) Collecting dulwich<0.22.0,>=0.21.2 (from poetry) Downloading dulwich-0.21.7-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (516 kB) âââââââââââââââââââââââââââââââââââââââ 516.4/516.4 kB 1.5 MB/s eta 0:00:00 Collecting fastjsonschema<3.0.0,>=2.18.0 (from poetry) Downloading fastjsonschema-2.19.1-py3-none-any.whl (23 kB) Collecting installer<0.8.0,>=0.7.0 (from poetry) Downloading installer-0.7.0-py3-none-any.whl (453 kB) âââââââââââââââââââââââââââââââââââââââ 453.8/453.8 kB 2.3 MB/s eta 0:00:00 Collecting keyring<25.0.0,>=24.0.0 (from poetry) Downloading keyring-24.3.1-py3-none-any.whl (38 kB) Collecting packaging>=23.1 (from poetry) Downloading packaging-24.0-py3-none-any.whl (53 kB) ââââââââââââââââââââââââââââââââââââââââ 53.5/53.5 kB 2.3 MB/s eta 0:00:00 Collecting pexpect<5.0.0,>=4.7.0 (from poetry) Downloading pexpect-4.9.0-py2.py3-none-any.whl (63 kB) ââââââââââââââââââââââââââââââââââââââââ 63.8/63.8 kB 2.2 MB/s eta 0:00:00 Collecting pkginfo<2.0.0,>=1.9.4 (from poetry) Downloading pkginfo-1.10.0-py3-none-any.whl (30 kB) Collecting platformdirs<5,>=3.0.0 (from poetry) Downloading platformdirs-4.2.0-py3-none-any.whl (17 kB) Collecting poetry-core==1.9.0 (from poetry) Downloading poetry_core-1.9.0-py3-none-any.whl (309 kB) âââââââââââââââââââââââââââââââââââââââ 309.5/309.5 kB 2.5 MB/s eta 0:00:00 Collecting poetry-plugin-export<2.0.0,>=1.6.0 (from poetry) Downloading poetry_plugin_export-1.7.1-py3-none-any.whl (10 kB) Collecting pyproject-hooks<2.0.0,>=1.0.0 (from poetry) Downloading pyproject_hooks-1.0.0-py3-none-any.whl (9.3 kB) Collecting requests<3.0,>=2.26 (from poetry) Downloading requests-2.31.0-py3-none-any.whl (62 kB) ââââââââââââââââââââââââââââââââââââââââ 62.6/62.6 kB 2.7 MB/s eta 0:00:00s Collecting requests-toolbelt<2.0.0,>=1.0.0 (from poetry) Downloading requests_toolbelt-1.0.0-py2.py3-none-any.whl (54 kB) ââââââââââââââââââââââââââââââââââââââââ 54.5/54.5 kB 1.2 MB/s eta 0:00:00 Collecting shellingham<2.0,>=1.5 (from poetry) Downloading shellingham-1.5.4-py2.py3-none-any.whl (9.8 kB) Collecting tomlkit<1.0.0,>=0.11.4 (from poetry) Downloading tomlkit-0.12.4-py3-none-any.whl (37 kB) Collecting trove-classifiers>=2022.5.19 (from poetry) Downloading trove_classifiers-2024.3.25-py3-none-any.whl (13 kB) Collecting virtualenv<21.0.0,>=20.23.0 (from poetry) Downloading virtualenv-20.25.1-py3-none-any.whl (3.8 MB) ââââââââââââââââââââââââââââââââââââââââ 3.8/3.8 MB 1.9 MB/s eta 0:00:00 Collecting msgpack<2.0.0,>=0.5.2 (from cachecontrol[filecache]<0.15.0,>=0.14.0->poetry) Downloading msgpack-1.0.8-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (409 kB) âââââââââââââââââââââââââââââââââââââââ 409.3/409.3 kB 1.7 MB/s eta 0:00:00 Collecting filelock>=3.8.0 (from cachecontrol[filecache]<0.15.0,>=0.14.0->poetry) Downloading filelock-3.13.3-py3-none-any.whl (11 kB) Collecting rapidfuzz<4.0.0,>=3.0.0 (from cleo<3.0.0,>=2.1.0->poetry) Downloading rapidfuzz-3.7.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.4 MB) ââââââââââââââââââââââââââââââââââââââââ 3.4/3.4 MB 2.2 MB/s eta 0:00:00 Collecting urllib3>=1.25 (from dulwich<0.22.0,>=0.21.2->poetry) Downloading urllib3-2.2.1-py3-none-any.whl (121 kB) âââââââââââââââââââââââââââââââââââââââ 121.1/121.1 kB 2.1 MB/s eta 0:00:00 Collecting jaraco.classes (from keyring<25.0.0,>=24.0.0->poetry) Downloading jaraco.classes-3.4.0-py3-none-any.whl (6.8 kB) Collecting importlib-metadata>=4.11.4 (from keyring<25.0.0,>=24.0.0->poetry) Downloading importlib_metadata-7.1.0-py3-none-any.whl (24 kB) Collecting SecretStorage>=3.2 (from keyring<25.0.0,>=24.0.0->poetry) Downloading SecretStorage-3.3.3-py3-none-any.whl (15 kB) Collecting jeepney>=0.4.2 (from keyring<25.0.0,>=24.0.0->poetry) Downloading jeepney-0.8.0-py3-none-any.whl (48 kB) ââââââââââââââââââââââââââââââââââââââââ 48.4/48.4 kB 2.4 MB/s eta 0:00:00 Collecting ptyprocess>=0.5 (from pexpect<5.0.0,>=4.7.0->poetry) Downloading ptyprocess-0.7.0-py2.py3-none-any.whl (13 kB) Collecting charset-normalizer<4,>=2 (from requests<3.0,>=2.26->poetry) Downloading charset_normalizer-3.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (140 kB) âââââââââââââââââââââââââââââââââââââââ 140.3/140.3 kB 1.7 MB/s eta 0:00:00 Collecting idna<4,>=2.5 (from requests<3.0,>=2.26->poetry) Downloading idna-3.6-py3-none-any.whl (61 kB) ââââââââââââââââââââââââââââââââââââââââ 61.6/61.6 kB 1.8 MB/s eta 0:00:00 Collecting certifi>=2017.4.17 (from requests<3.0,>=2.26->poetry) Downloading certifi-2024.2.2-py3-none-any.whl (163 kB) âââââââââââââââââââââââââââââââââââââââ 163.8/163.8 kB 1.9 MB/s eta 0:00:00 Collecting distlib<1,>=0.3.7 (from virtualenv<21.0.0,>=20.23.0->poetry) Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) âââââââââââââââââââââââââââââââââââââââ 468.9/468.9 kB 1.8 MB/s eta 0:00:00 Collecting zipp>=0.5 (from importlib-metadata>=4.11.4->keyring<25.0.0,>=24.0.0->poetry) Downloading zipp-3.18.1-py3-none-any.whl (8.2 kB) Collecting cryptography>=2.0 (from SecretStorage>=3.2->keyring<25.0.0,>=24.0.0->poetry) Downloading cryptography-42.0.5-cp39-abi3-manylinux_2_28_x86_64.whl (4.6 MB) ââââââââââââââââââââââââââââââââââââââââ 4.6/4.6 MB 1.7 MB/s eta 0:00:00 Collecting more-itertools (from jaraco.classes->keyring<25.0.0,>=24.0.0->poetry) Downloading more_itertools-10.2.0-py3-none-any.whl (57 kB) ââââââââââââââââââââââââââââââââââââââââ 57.0/57.0 kB 1.9 MB/s eta 0:00:00 Collecting cffi>=1.12 (from cryptography>=2.0->SecretStorage>=3.2->keyring<25.0.0,>=24.0.0->poetry) Downloading cffi-1.16.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (464 kB) âââââââââââââââââââââââââââââââââââââââ 464.8/464.8 kB 1.4 MB/s eta 0:00:00 Collecting pycparser (from cffi>=1.12->cryptography>=2.0->SecretStorage>=3.2->keyring<25.0.0,>=24.0.0->poetry) Downloading pycparser-2.22-py3-none-any.whl (117 kB) âââââââââââââââââââââââââââââââââââââââ 117.6/117.6 kB 1.4 MB/s eta 0:00:00 Installing collected packages: trove-classifiers, ptyprocess, fastjsonschema, distlib, zipp, urllib3, tomlkit, shellingham, rapidfuzz, pyproject-hooks, pycparser, poetry-core, platformdirs, pkginfo, pexpect, packaging, msgpack, more-itertools, jeepney, installer, idna, filelock, crashtest, charset-normalizer, certifi, virtualenv, requests, jaraco.classes, importlib-metadata, dulwich, cleo, cffi, build, requests-toolbelt, cryptography, cachecontrol, SecretStorage, keyring, poetry-plugin-export, poetry Successfully installed SecretStorage-3.3.3 build-1.2.1 cachecontrol-0.14.0 certifi-2024.2.2 cffi-1.16.0 charset-normalizer-3.3.2 cleo-2.1.0 crashtest-0.4.1 cryptography-42.0.5 distlib-0.3.8 dulwich-0.21.7 fastjsonschema-2.19.1 filelock-3.13.3 idna-3.6 importlib-metadata-7.1.0 installer-0.7.0 jaraco.classes-3.4.0 jeepney-0.8.0 keyring-24.3.1 more-itertools-10.2.0 msgpack-1.0.8 packaging-24.0 pexpect-4.9.0 pkginfo-1.10.0 platformdirs-4.2.0 poetry-1.8.2 poetry-core-1.9.0 poetry-plugin-export-1.7.1 ptyprocess-0.7.0 pycparser-2.22 pyproject-hooks-1.0.0 rapidfuzz-3.7.0 requests-2.31.0 requests-toolbelt-1.0.0 shellingham-1.5.4 tomlkit-0.12.4 trove-classifiers-2024.3.25 urllib3-2.2.1 virtualenv-20.25.1 zipp-3.18.1 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv [notice] A new release of pip is available: 23.1.2 -> 24.0 [notice] To update, run: pip install --upgrade pip [builder 3/6] WORKDIR /app/ [builder 5/6] ADD download_embedder.py /app/ [builder 6/6] RUN --mount=type=cache,target=/tmp/poetry_cache poetry install --no-root --no-ansi --with worker,api --without ai,ingester,dev,streamlit-app Creating virtualenv redbox in /app/.venv Installing dependencies from lock file Package operations: 129 installs, 1 update, 0 removals - Installing six (1.16.0) - Installing markupsafe (2.1.5) - Installing mdurl (0.1.2) - Installing python-dateutil (2.8.2) - Installing pyyaml (6.0.1) - Installing typing-extensions (4.9.0) - Installing annotated-types (0.6.0) - Installing certifi (2024.2.2) - Installing charset-normalizer (3.3.2) - Installing ghp-import (2.1.0) - Installing click (8.1.7) - Installing markdown (3.5.2) - Installing idna (3.6) - Installing jinja2 (3.1.3) - Installing packaging (23.2) - Installing markdown-it-py (3.0.0) - Installing mergedeep (1.3.4) - Installing pathspec (0.12.1) - Installing platformdirs (4.2.0) - Installing pyyaml-env-tag (0.1) - Installing pydantic-core (2.16.3) - Installing urllib3 (1.26.18) - Installing watchdog (4.0.0) - Installing pygments (2.17.2) - Installing filelock (3.13.1) - Installing frozenlist (1.4.1) - Installing fsspec (2024.2.0) - Installing mkdocs (1.5.3) - Installing jsonpointer (2.4) - Installing mypy-extensions (1.0.0) - Installing multidict (6.0.5) - Installing nvidia-nvjitlink-cu12 (12.4.99) - Installing orjson (3.10.0) - Installing pydantic (2.6.4) - Installing requests (2.31.0) - Installing rich (13.7.1) - Installing shellingham (1.5.4) - Installing tqdm (4.66.2) - Installing aiosignal (1.3.1) - Installing attrs (23.2.0) - Installing greenlet (3.0.3) - Installing jmespath (1.0.1) - Installing huggingface-hub (0.20.3) - Installing langsmith (0.1.39) - Installing colorama (0.4.6) - Installing mpmath (1.3.0) - Installing jsonpatch (1.33) - Installing marshmallow (3.20.2) - Installing pymdown-extensions (10.7.1) - Installing numpy (1.26.4) - Installing tenacity (8.2.3) - Installing typer-slim (0.12.0) - Installing nvidia-cusparse-cu12 (12.1.0.106) - Installing yarl (1.9.4) - Installing sniffio (1.3.1) - Installing typing-inspect (0.9.0) - Installing nvidia-cublas-cu12 (12.1.3.1) - Installing mkdocs-autorefs (1.0.1) Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file - Installing aiohttp (3.9.3) - Installing anyio (4.3.0) - Installing babel (2.14.0) - Installing botocore (1.34.77) - Installing editorconfig (0.12.4) - Installing griffe (0.42.1) - Installing joblib (1.3.2) - Installing langchain-core (0.1.39) - Installing log-symbols (0.0.14) - Installing mkdocstrings (0.24.2) - Installing networkx (3.2.1) - Installing mkdocs-material-extensions (1.3.1) - Installing nvidia-cuda-runtime-cu12 (12.1.105) - Installing nvidia-cudnn-cu12 (8.9.2.26) - Installing nvidia-curand-cu12 (10.3.2.106) - Installing nvidia-cusolver-cu12 (11.4.5.107) - Installing dataclasses-json (0.6.4) - Installing nvidia-cuda-cupti-cu12 (12.1.105) - Installing nvidia-cufft-cu12 (11.0.2.54) - Installing nvidia-cuda-nvrtc-cu12 (12.1.105) - Installing nvidia-nccl-cu12 (2.19.3) - Installing nvidia-nvtx-cu12 (12.1.105) - Installing paginate (0.5.6) - Installing regex (2023.12.25) - Installing safetensors (0.3.2) Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file - Installing scipy (1.10.1) - Installing soupsieve (2.5) - Installing spinners (0.0.24) - Installing sqlalchemy (2.0.29) - Installing sympy (1.12) - Installing termcolor (2.4.0) - Installing threadpoolctl (3.4.0) - Installing tokenizers (0.15.2) - Installing triton (2.2.0) - Installing typer-cli (0.12.0) Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file - Installing beautifulsoup4 (4.12.3) - Installing bump2version (1.0.1) - Installing elastic-transport (8.13.0) - Installing fast-depends (2.4.2) - Installing h11 (0.14.0) - Installing jsbeautifier (1.15.1) - Installing langchain-community (0.0.31) - Installing halo (0.0.31) - Installing mkdocstrings-python (1.9.2) - Installing pillow (10.2.0) - Installing redis (5.0.3) - Installing mkdocs-material (9.5.17) - Installing langchain-text-splitters (0.0.1) - Installing scikit-learn (1.4.1.post1) - Installing starlette (0.37.2) - Installing tabulate (0.9.0) - Installing python-dotenv (1.0.1) - Installing s3transfer (0.10.1) - Updating setuptools (69.1.0 -> 69.2.0) - Installing torch (2.2.0) - Installing transformers (4.37.1) - Installing typer (0.12.0) - Installing boto3 (1.34.77) - Installing bumpversion (0.6.0) - Installing elasticsearch (8.13.0) - Installing fastapi (0.110.1) - Installing langchain (0.1.14) - Installing faststream (0.4.7) - Installing mkapi (2.1.0) - Installing markdown-mdantic (2.1.0) - Installing pydantic-settings (2.2.1) - Installing sentence-transformers (2.6.1) - Installing mkdocs-mermaid2-plugin (1.1.1) - Installing uvicorn (0.29.0) - Installing python-multipart (0.0.9) - Installing tiktoken (0.6.0) - Installing pika (1.3.2) [builder 4/6] ADD pyproject.toml poetry.lock ./ [runtime 2/7] COPY --from=builder /app/.venv /app/.venv ```

ingester

```markdown [internal] load build definition from Dockerfile transferring 951/0 0.003 [internal] load metadata for docker.io/library/python:3.11-slim-buster [internal] load metadata for docker.io/library/python:3.11-buster [internal] load .dockerignore [builder 1/6] FROM docker.io/library/python:3.11-buster@sha256:3a19b4d6ce4402d11bb19aa11416e4a262a60a57707a5cda5787a81285df2666 resolve docker.io/library/python:3.11-buster@sha256:3a19b4d6ce4402d11bb19aa11416e4a262a60a57707a5cda5787a81285df2666 0/0 0.024 done 988/988 -0.345 done 2007/2007 -0.234 done 7522/7522 -0.073 done 17579218/17579218 77.3 done 50448512/50448512 88.973 done 6147835/6147835 99.867 done 51870721/51870721 103.847 done 244/244 104.012 done 3089898/3089898 106.163 done 22309962/22309962 113.162 done 191876389/191876389 153.408 extract 0/0 3.868 extract 0/0 0.804 extract 0/0 4.02 extract 0/0 10.038 extract 0/0 0.427 extract 0/0 0.986 extract 0/0 0 extract 0/0 0.414 [internal] load build context transferring 828150/0 0.043 [runtime 1/8] FROM docker.io/library/python:3.11-slim-buster@sha256:c46b0ae5728c2247b99903098ade3176a58e274d9c7d2efeaaab3e0621a53935 resolve docker.io/library/python:3.11-slim-buster@sha256:c46b0ae5728c2247b99903098ade3176a58e274d9c7d2efeaaab3e0621a53935 0/0 0.023 done 988/988 -0.412 done 1370/1370 -0.288 done 6834/6834 -0.116 done 27138450/27138450 53.333 done 2781342/2781342 53.691 done 244/244 53.832 done 3380069/3380069 55.495 done 11996761/11996761 58.553 extract 0/0 2.513 extract 0/0 0.221 extract 0/0 0.75 extract 0/0 0 extract 0/0 0.441 [runtime 2/8] RUN apt update && apt-get install -y poppler-utils tesseract-ocr WARNING: apt does not have a stable CLI interface. Use with caution in scripts. Get:1 http://deb.debian.org/debian buster InRelease [122 kB] Get:2 http://deb.debian.org/debian-security buster/updates InRelease [34.8 kB] Get:3 http://deb.debian.org/debian buster-updates InRelease [56.6 kB] Get:4 http://deb.debian.org/debian buster/main amd64 Packages [7909 kB] Get:5 http://deb.debian.org/debian-security buster/updates/main amd64 Packages [592 kB] Get:6 http://deb.debian.org/debian buster-updates/main amd64 Packages [8788 B] Fetched 8723 kB in 4s (2413 kB/s) Reading package lists... Building dependency tree... Reading state information... 12 packages can be upgraded. Run 'apt list --upgradable' to see them. Reading package lists... Building dependency tree... Reading state information... The following additional packages will be installed: fontconfig fontconfig-config fonts-dejavu-core libbsd0 libcairo2 libdatrie1 libfontconfig1 libfreetype6 libfribidi0 libgif7 libglib2.0-0 libglib2.0-data libgomp1 libgraphite2-3 libharfbuzz0b libicu63 libjbig0 libjpeg62-turbo liblcms2-2 liblept5 libnspr4 libnss3 libopenjp2-7 libpango-1.0-0 libpangocairo-1.0-0 libpangoft2-1.0-0 libpixman-1-0 libpng16-16 libpoppler82 libtesseract4 libthai-data libthai0 libtiff5 libwebp6 libx11-6 libx11-data libxau6 libxcb-render0 libxcb-shm0 libxcb1 libxdmcp6 libxext6 libxml2 libxrender1 poppler-data sensible-utils shared-mime-info tesseract-ocr-eng tesseract-ocr-osd ucf xdg-user-dirs Suggested packages: liblcms2-utils ghostscript fonts-japanese-mincho | fonts-ipafont-mincho fonts-japanese-gothic | fonts-ipafont-gothic fonts-arphic-ukai fonts-arphic-uming fonts-nanum The following NEW packages will be installed: fontconfig fontconfig-config fonts-dejavu-core libbsd0 libcairo2 libdatrie1 libfontconfig1 libfreetype6 libfribidi0 libgif7 libglib2.0-0 libglib2.0-data libgomp1 libgraphite2-3 libharfbuzz0b libicu63 libjbig0 libjpeg62-turbo liblcms2-2 liblept5 libnspr4 libnss3 libopenjp2-7 libpango-1.0-0 libpangocairo-1.0-0 libpangoft2-1.0-0 libpixman-1-0 libpng16-16 libpoppler82 libtesseract4 libthai-data libthai0 libtiff5 libwebp6 libx11-6 libx11-data libxau6 libxcb-render0 libxcb-shm0 libxcb1 libxdmcp6 libxext6 libxml2 libxrender1 poppler-data poppler-utils sensible-utils shared-mime-info tesseract-ocr tesseract-ocr-eng tesseract-ocr-osd ucf xdg-user-dirs 0 upgraded, 53 newly installed, 0 to remove and 12 not upgraded. Need to get 32.2 MB of archives. After this operation, 115 MB of additional disk space will be used. Get:1 http://deb.debian.org/debian buster/main amd64 poppler-data all 0.4.9-2 [1473 kB] Get:2 http://deb.debian.org/debian buster/main amd64 sensible-utils all 0.0.12 [15.8 kB] Get:3 http://deb.debian.org/debian buster/main amd64 libicu63 amd64 63.1-6+deb10u3 [8293 kB] Get:4 http://deb.debian.org/debian-security buster/updates/main amd64 libxml2 amd64 2.9.4+dfsg1-7+deb10u6 [690 kB] Get:5 http://deb.debian.org/debian buster/main amd64 ucf all 3.0038+nmu1 [69.0 kB] Get:6 http://deb.debian.org/debian buster/main amd64 libpng16-16 amd64 1.6.36-6 [292 kB] Get:7 http://deb.debian.org/debian buster/main amd64 libfreetype6 amd64 2.9.1-3+deb10u3 [380 kB] Get:8 http://deb.debian.org/debian buster/main amd64 fonts-dejavu-core all 2.37-1 [1068 kB] Get:9 http://deb.debian.org/debian buster/main amd64 fontconfig-config all 2.13.1-2 [280 kB] Get:10 http://deb.debian.org/debian buster/main amd64 libfontconfig1 amd64 2.13.1-2 [346 kB] Get:11 http://deb.debian.org/debian buster/main amd64 fontconfig amd64 2.13.1-2 [405 kB] Get:12 http://deb.debian.org/debian buster/main amd64 libbsd0 amd64 0.9.1-2+deb10u1 [99.5 kB] Get:13 http://deb.debian.org/debian-security buster/updates/main amd64 libpixman-1-0 amd64 0.36.0-1+deb10u1 [234 kB] Get:14 http://deb.debian.org/debian buster/main amd64 libxau6 amd64 1:1.0.8-1+b2 [19.9 kB] Get:15 http://deb.debian.org/debian buster/main amd64 libxdmcp6 amd64 1:1.1.2-3 [26.3 kB] Get:16 http://deb.debian.org/debian buster/main amd64 libxcb1 amd64 1.13.1-2 [137 kB] Get:17 http://deb.debian.org/debian-security buster/updates/main amd64 libx11-data all 2:1.6.7-1+deb10u4 [299 kB] Get:18 http://deb.debian.org/debian-security buster/updates/main amd64 libx11-6 amd64 2:1.6.7-1+deb10u4 [758 kB] Get:19 http://deb.debian.org/debian buster/main amd64 libxcb-render0 amd64 1.13.1-2 [109 kB] Get:20 http://deb.debian.org/debian buster/main amd64 libxcb-shm0 amd64 1.13.1-2 [99.2 kB] Get:21 http://deb.debian.org/debian buster/main amd64 libxext6 amd64 2:1.3.3-1+b2 [52.5 kB] Get:22 http://deb.debian.org/debian buster/main amd64 libxrender1 amd64 1:0.9.10-1 [33.0 kB] Get:23 http://deb.debian.org/debian buster/main amd64 libcairo2 amd64 1.16.0-4+deb10u1 [688 kB] Get:24 http://deb.debian.org/debian buster/main amd64 libdatrie1 amd64 0.2.12-2 [39.3 kB] Get:25 http://deb.debian.org/debian buster/main amd64 libfribidi0 amd64 1.0.5-3.1+deb10u2 [63.9 kB] Get:26 http://deb.debian.org/debian-security buster/updates/main amd64 libgif7 amd64 5.1.4-3+deb10u1 [43.4 kB] Get:27 http://deb.debian.org/debian-security buster/updates/main amd64 libglib2.0-0 amd64 2.58.3-2+deb10u5 [1261 kB] Get:28 http://deb.debian.org/debian-security buster/updates/main amd64 libglib2.0-data all 2.58.3-2+deb10u5 [1110 kB] Get:29 http://deb.debian.org/debian buster/main amd64 libgomp1 amd64 8.3.0-6 [75.8 kB] Get:30 http://deb.debian.org/debian buster/main amd64 libgraphite2-3 amd64 1.3.13-7 [80.7 kB] Get:31 http://deb.debian.org/debian buster/main amd64 libharfbuzz0b amd64 2.3.1-1 [1187 kB] Get:32 http://deb.debian.org/debian buster/main amd64 libjbig0 amd64 2.1-3.1+b2 [31.0 kB] Get:33 http://deb.debian.org/debian buster/main amd64 libjpeg62-turbo amd64 1:1.5.2-2+deb10u1 [133 kB] Get:34 http://deb.debian.org/debian buster/main amd64 liblcms2-2 amd64 2.9-3 [145 kB] Get:35 http://deb.debian.org/debian buster/main amd64 libopenjp2-7 amd64 2.3.0-2+deb10u2 [158 kB] Get:36 http://deb.debian.org/debian-security buster/updates/main amd64 libwebp6 amd64 0.6.1-2+deb10u3 [263 kB] Get:37 http://deb.debian.org/debian-security buster/updates/main amd64 libtiff5 amd64 4.1.0+git191117-2~deb10u9 [273 kB] Get:38 http://deb.debian.org/debian-security buster/updates/main amd64 liblept5 amd64 1.76.0-1+deb10u2 [945 kB] Get:39 http://deb.debian.org/debian buster/main amd64 libnspr4 amd64 2:4.20-1 [112 kB] Get:40 http://deb.debian.org/debian-security buster/updates/main amd64 libnss3 amd64 2:3.42.1-1+deb10u8 [1246 kB] Get:41 http://deb.debian.org/debian buster/main amd64 libthai-data all 0.1.28-2 [170 kB] Get:42 http://deb.debian.org/debian buster/main amd64 libthai0 amd64 0.1.28-2 [54.1 kB] Get:43 http://deb.debian.org/debian buster/main amd64 libpango-1.0-0 amd64 1.42.4-8~deb10u1 [186 kB] Get:44 http://deb.debian.org/debian buster/main amd64 libpangoft2-1.0-0 amd64 1.42.4-8~deb10u1 [68.3 kB] Get:45 http://deb.debian.org/debian buster/main amd64 libpangocairo-1.0-0 amd64 1.42.4-8~deb10u1 [55.7 kB] Get:46 http://deb.debian.org/debian-security buster/updates/main amd64 libpoppler82 amd64 0.71.0-5+deb10u3 [1508 kB] Get:47 http://deb.debian.org/debian buster/main amd64 libtesseract4 amd64 4.0.0-2 [1234 kB] Get:48 http://deb.debian.org/debian-security buster/updates/main amd64 poppler-utils amd64 0.71.0-5+deb10u3 [185 kB] Get:49 http://deb.debian.org/debian buster/main amd64 shared-mime-info amd64 1.10-1 [766 kB] Get:50 http://deb.debian.org/debian buster/main amd64 tesseract-ocr-eng all 1:4.00~git30-7274cfa-1 [1592 kB] Get:51 http://deb.debian.org/debian buster/main amd64 tesseract-ocr-osd all 1:4.00~git30-7274cfa-1 [2991 kB] Get:52 http://deb.debian.org/debian buster/main amd64 tesseract-ocr amd64 4.0.0-2 [262 kB] Get:53 http://deb.debian.org/debian buster/main amd64 xdg-user-dirs amd64 0.17-2 [53.8 kB] debconf: delaying package configuration, since apt-utils is not installed Fetched 32.2 MB in 21s (1522 kB/s) Selecting previously unselected package poppler-data. (Reading database ...(Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75%(Reading database ... 80%(Reading database ... 85%(Reading database ... 90%(Reading database ... 95%(Reading database ... 100% (Reading database ... 6843 files and directories currently installed.) Preparing to unpack .../00-poppler-data_0.4.9-2_all.deb ... Unpacking poppler-data (0.4.9-2) ... Selecting previously unselected package sensible-utils. Preparing to unpack .../01-sensible-utils_0.0.12_all.deb ... Unpacking sensible-utils (0.0.12) ... Selecting previously unselected package libicu63:amd64. Preparing to unpack .../02-libicu63_63.1-6+deb10u3_amd64.deb ... Unpacking libicu63:amd64 (63.1-6+deb10u3) ... Selecting previously unselected package libxml2:amd64. Preparing to unpack .../03-libxml2_2.9.4+dfsg1-7+deb10u6_amd64.deb ... Unpacking libxml2:amd64 (2.9.4+dfsg1-7+deb10u6) ... Selecting previously unselected package ucf. Preparing to unpack .../04-ucf_3.0038+nmu1_all.deb ... Moving old data out of the way Unpacking ucf (3.0038+nmu1) ... Selecting previously unselected package libpng16-16:amd64. Preparing to unpack .../05-libpng16-16_1.6.36-6_amd64.deb ... Unpacking libpng16-16:amd64 (1.6.36-6) ... Selecting previously unselected package libfreetype6:amd64. Preparing to unpack .../06-libfreetype6_2.9.1-3+deb10u3_amd64.deb ... Unpacking libfreetype6:amd64 (2.9.1-3+deb10u3) ... Selecting previously unselected package fonts-dejavu-core. Preparing to unpack .../07-fonts-dejavu-core_2.37-1_all.deb ... Unpacking fonts-dejavu-core (2.37-1) ... Selecting previously unselected package fontconfig-config. Preparing to unpack .../08-fontconfig-config_2.13.1-2_all.deb ... Unpacking fontconfig-config (2.13.1-2) ... Selecting previously unselected package libfontconfig1:amd64. Preparing to unpack .../09-libfontconfig1_2.13.1-2_amd64.deb ... Unpacking libfontconfig1:amd64 (2.13.1-2) ... Selecting previously unselected package fontconfig. Preparing to unpack .../10-fontconfig_2.13.1-2_amd64.deb ... Unpacking fontconfig (2.13.1-2) ... Selecting previously unselected package libbsd0:amd64. Preparing to unpack .../11-libbsd0_0.9.1-2+deb10u1_amd64.deb ... Unpacking libbsd0:amd64 (0.9.1-2+deb10u1) ... Selecting previously unselected package libpixman-1-0:amd64. Preparing to unpack .../12-libpixman-1-0_0.36.0-1+deb10u1_amd64.deb ... Unpacking libpixman-1-0:amd64 (0.36.0-1+deb10u1) ... Selecting previously unselected package libxau6:amd64. Preparing to unpack .../13-libxau6_1%3a1.0.8-1+b2_amd64.deb ... Unpacking libxau6:amd64 (1:1.0.8-1+b2) ... Selecting previously unselected package libxdmcp6:amd64. Preparing to unpack .../14-libxdmcp6_1%3a1.1.2-3_amd64.deb ... Unpacking libxdmcp6:amd64 (1:1.1.2-3) ... Selecting previously unselected package libxcb1:amd64. Preparing to unpack .../15-libxcb1_1.13.1-2_amd64.deb ... Unpacking libxcb1:amd64 (1.13.1-2) ... Selecting previously unselected package libx11-data. Preparing to unpack .../16-libx11-data_2%3a1.6.7-1+deb10u4_all.deb ... Unpacking libx11-data (2:1.6.7-1+deb10u4) ... Selecting previously unselected package libx11-6:amd64. Preparing to unpack .../17-libx11-6_2%3a1.6.7-1+deb10u4_amd64.deb ... Unpacking libx11-6:amd64 (2:1.6.7-1+deb10u4) ... Selecting previously unselected package libxcb-render0:amd64. Preparing to unpack .../18-libxcb-render0_1.13.1-2_amd64.deb ... Unpacking libxcb-render0:amd64 (1.13.1-2) ... Selecting previously unselected package libxcb-shm0:amd64. Preparing to unpack .../19-libxcb-shm0_1.13.1-2_amd64.deb ... Unpacking libxcb-shm0:amd64 (1.13.1-2) ... Selecting previously unselected package libxext6:amd64. Preparing to unpack .../20-libxext6_2%3a1.3.3-1+b2_amd64.deb ... Unpacking libxext6:amd64 (2:1.3.3-1+b2) ... Selecting previously unselected package libxrender1:amd64. Preparing to unpack .../21-libxrender1_1%3a0.9.10-1_amd64.deb ... Unpacking libxrender1:amd64 (1:0.9.10-1) ... Selecting previously unselected package libcairo2:amd64. Preparing to unpack .../22-libcairo2_1.16.0-4+deb10u1_amd64.deb ... Unpacking libcairo2:amd64 (1.16.0-4+deb10u1) ... Selecting previously unselected package libdatrie1:amd64. Preparing to unpack .../23-libdatrie1_0.2.12-2_amd64.deb ... Unpacking libdatrie1:amd64 (0.2.12-2) ... Selecting previously unselected package libfribidi0:amd64. Preparing to unpack .../24-libfribidi0_1.0.5-3.1+deb10u2_amd64.deb ... Unpacking libfribidi0:amd64 (1.0.5-3.1+deb10u2) ... Selecting previously unselected package libgif7:amd64. Preparing to unpack .../25-libgif7_5.1.4-3+deb10u1_amd64.deb ... Unpacking libgif7:amd64 (5.1.4-3+deb10u1) ... Selecting previously unselected package libglib2.0-0:amd64. Preparing to unpack .../26-libglib2.0-0_2.58.3-2+deb10u5_amd64.deb ... Unpacking libglib2.0-0:amd64 (2.58.3-2+deb10u5) ... Selecting previously unselected package libglib2.0-data. Preparing to unpack .../27-libglib2.0-data_2.58.3-2+deb10u5_all.deb ... Unpacking libglib2.0-data (2.58.3-2+deb10u5) ... Selecting previously unselected package libgomp1:amd64. Preparing to unpack .../28-libgomp1_8.3.0-6_amd64.deb ... Unpacking libgomp1:amd64 (8.3.0-6) ... Selecting previously unselected package libgraphite2-3:amd64. Preparing to unpack .../29-libgraphite2-3_1.3.13-7_amd64.deb ... Unpacking libgraphite2-3:amd64 (1.3.13-7) ... Selecting previously unselected package libharfbuzz0b:amd64. Preparing to unpack .../30-libharfbuzz0b_2.3.1-1_amd64.deb ... Unpacking libharfbuzz0b:amd64 (2.3.1-1) ... Selecting previously unselected package libjbig0:amd64. Preparing to unpack .../31-libjbig0_2.1-3.1+b2_amd64.deb ... Unpacking libjbig0:amd64 (2.1-3.1+b2) ... Selecting previously unselected package libjpeg62-turbo:amd64. Preparing to unpack .../32-libjpeg62-turbo_1%3a1.5.2-2+deb10u1_amd64.deb ... Unpacking libjpeg62-turbo:amd64 (1:1.5.2-2+deb10u1) ... Selecting previously unselected package liblcms2-2:amd64. Preparing to unpack .../33-liblcms2-2_2.9-3_amd64.deb ... Unpacking liblcms2-2:amd64 (2.9-3) ... Selecting previously unselected package libopenjp2-7:amd64. Preparing to unpack .../34-libopenjp2-7_2.3.0-2+deb10u2_amd64.deb ... Unpacking libopenjp2-7:amd64 (2.3.0-2+deb10u2) ... Selecting previously unselected package libwebp6:amd64. Preparing to unpack .../35-libwebp6_0.6.1-2+deb10u3_amd64.deb ... Unpacking libwebp6:amd64 (0.6.1-2+deb10u3) ... Selecting previously unselected package libtiff5:amd64. Preparing to unpack .../36-libtiff5_4.1.0+git191117-2~deb10u9_amd64.deb ... Unpacking libtiff5:amd64 (4.1.0+git191117-2~deb10u9) ... Selecting previously unselected package liblept5. Preparing to unpack .../37-liblept5_1.76.0-1+deb10u2_amd64.deb ... Unpacking liblept5 (1.76.0-1+deb10u2) ... Selecting previously unselected package libnspr4:amd64. Preparing to unpack .../38-libnspr4_2%3a4.20-1_amd64.deb ... Unpacking libnspr4:amd64 (2:4.20-1) ... Selecting previously unselected package libnss3:amd64. Preparing to unpack .../39-libnss3_2%3a3.42.1-1+deb10u8_amd64.deb ... Unpacking libnss3:amd64 (2:3.42.1-1+deb10u8) ... Selecting previously unselected package libthai-data. Preparing to unpack .../40-libthai-data_0.1.28-2_all.deb ... Unpacking libthai-data (0.1.28-2) ... Selecting previously unselected package libthai0:amd64. Preparing to unpack .../41-libthai0_0.1.28-2_amd64.deb ... Unpacking libthai0:amd64 (0.1.28-2) ... Selecting previously unselected package libpango-1.0-0:amd64. Preparing to unpack .../42-libpango-1.0-0_1.42.4-8~deb10u1_amd64.deb ... Unpacking libpango-1.0-0:amd64 (1.42.4-8~deb10u1) ... Selecting previously unselected package libpangoft2-1.0-0:amd64. Preparing to unpack .../43-libpangoft2-1.0-0_1.42.4-8~deb10u1_amd64.deb ... Unpacking libpangoft2-1.0-0:amd64 (1.42.4-8~deb10u1) ... Selecting previously unselected package libpangocairo-1.0-0:amd64. Preparing to unpack .../44-libpangocairo-1.0-0_1.42.4-8~deb10u1_amd64.deb ... Unpacking libpangocairo-1.0-0:amd64 (1.42.4-8~deb10u1) ... Selecting previously unselected package libpoppler82:amd64. Preparing to unpack .../45-libpoppler82_0.71.0-5+deb10u3_amd64.deb ... Unpacking libpoppler82:amd64 (0.71.0-5+deb10u3) ... Selecting previously unselected package libtesseract4:amd64. Preparing to unpack .../46-libtesseract4_4.0.0-2_amd64.deb ... Unpacking libtesseract4:amd64 (4.0.0-2) ... Selecting previously unselected package poppler-utils. Preparing to unpack .../47-poppler-utils_0.71.0-5+deb10u3_amd64.deb ... Unpacking poppler-utils (0.71.0-5+deb10u3) ... Selecting previously unselected package shared-mime-info. Preparing to unpack .../48-shared-mime-info_1.10-1_amd64.deb ... Unpacking shared-mime-info (1.10-1) ... Selecting previously unselected package tesseract-ocr-eng. Preparing to unpack .../49-tesseract-ocr-eng_1%3a4.00~git30-7274cfa-1_all.deb ... Unpacking tesseract-ocr-eng (1:4.00~git30-7274cfa-1) ... Selecting previously unselected package tesseract-ocr-osd. Preparing to unpack .../50-tesseract-ocr-osd_1%3a4.00~git30-7274cfa-1_all.deb ... Unpacking tesseract-ocr-osd (1:4.00~git30-7274cfa-1) ... Selecting previously unselected package tesseract-ocr. Preparing to unpack .../51-tesseract-ocr_4.0.0-2_amd64.deb ... Unpacking tesseract-ocr (4.0.0-2) ... Selecting previously unselected package xdg-user-dirs. Preparing to unpack .../52-xdg-user-dirs_0.17-2_amd64.deb ... Unpacking xdg-user-dirs (0.17-2) ... Setting up libgraphite2-3:amd64 (1.3.13-7) ... Setting up liblcms2-2:amd64 (2.9-3) ... Setting up libpixman-1-0:amd64 (0.36.0-1+deb10u1) ... Setting up libxau6:amd64 (1:1.0.8-1+b2) ... Setting up libdatrie1:amd64 (0.2.12-2) ... Setting up xdg-user-dirs (0.17-2) ... Setting up libglib2.0-0:amd64 (2.58.3-2+deb10u5) ... No schema files found: doing nothing. Setting up tesseract-ocr-eng (1:4.00~git30-7274cfa-1) ... Setting up libgomp1:amd64 (8.3.0-6) ... Setting up libjbig0:amd64 (2.1-3.1+b2) ... Setting up libicu63:amd64 (63.1-6+deb10u3) ... Setting up poppler-data (0.4.9-2) ... Setting up libglib2.0-data (2.58.3-2+deb10u5) ... Setting up libjpeg62-turbo:amd64 (1:1.5.2-2+deb10u1) ... Setting up libx11-data (2:1.6.7-1+deb10u4) ... Setting up libnspr4:amd64 (2:4.20-1) ... Setting up libfribidi0:amd64 (1.0.5-3.1+deb10u2) ... Setting up libpng16-16:amd64 (1.6.36-6) ... Setting up libwebp6:amd64 (0.6.1-2+deb10u3) ... Setting up fonts-dejavu-core (2.37-1) ... Setting up libgif7:amd64 (5.1.4-3+deb10u1) ... Setting up sensible-utils (0.0.12) ... Setting up libopenjp2-7:amd64 (2.3.0-2+deb10u2) ... Setting up libthai-data (0.1.28-2) ... Setting up libtiff5:amd64 (4.1.0+git191117-2~deb10u9) ... Setting up tesseract-ocr-osd (1:4.00~git30-7274cfa-1) ... Setting up libbsd0:amd64 (0.9.1-2+deb10u1) ... Setting up libxml2:amd64 (2.9.4+dfsg1-7+deb10u6) ... Setting up libxdmcp6:amd64 (1:1.1.2-3) ... Setting up libxcb1:amd64 (1.13.1-2) ... Setting up libxcb-render0:amd64 (1.13.1-2) ... Setting up libnss3:amd64 (2:3.42.1-1+deb10u8) ... Setting up libxcb-shm0:amd64 (1.13.1-2) ... Setting up liblept5 (1.76.0-1+deb10u2) ... Setting up libthai0:amd64 (0.1.28-2) ... Setting up libfreetype6:amd64 (2.9.1-3+deb10u3) ... Setting up shared-mime-info (1.10-1) ... Setting up ucf (3.0038+nmu1) ... debconf: unable to initialize frontend: Dialog debconf: (TERM is not set, so the dialog frontend is not usable.) debconf: falling back to frontend: Readline debconf: unable to initialize frontend: Readline debconf: (Can't locate Term/ReadLine.pm in @INC (you may need to install the Term::ReadLine module) (@INC contains: /etc/perl /usr/local/lib/x86_64-linux-gnu/perl/5.28.1 /usr/local/share/perl/5.28.1 /usr/lib/x86_64-linux-gnu/perl5/5.28 /usr/share/perl5 /usr/lib/x86_64-linux-gnu/perl/5.28 /usr/share/perl/5.28 /usr/local/lib/site_perl /usr/lib/x86_64-linux-gnu/perl-base) at /usr/share/perl5/Debconf/FrontEnd/Readline.pm line 7.) debconf: falling back to frontend: Teletype Setting up libtesseract4:amd64 (4.0.0-2) ... Setting up libx11-6:amd64 (2:1.6.7-1+deb10u4) ... Setting up libharfbuzz0b:amd64 (2.3.1-1) ... Setting up libxrender1:amd64 (1:0.9.10-1) ... Setting up fontconfig-config (2.13.1-2) ... debconf: unable to initialize frontend: Dialog debconf: (TERM is not set, so the dialog frontend is not usable.) debconf: falling back to frontend: Readline debconf: unable to initialize frontend: Readline debconf: (Can't locate Term/ReadLine.pm in @INC (you may need to install the Term::ReadLine module) (@INC contains: /etc/perl /usr/local/lib/x86_64-linux-gnu/perl/5.28.1 /usr/local/share/perl/5.28.1 /usr/lib/x86_64-linux-gnu/perl5/5.28 /usr/share/perl5 /usr/lib/x86_64-linux-gnu/perl/5.28 /usr/share/perl/5.28 /usr/local/lib/site_perl /usr/lib/x86_64-linux-gnu/perl-base) at /usr/share/perl5/Debconf/FrontEnd/Readline.pm line 7.) debconf: falling back to frontend: Teletype Setting up libxext6:amd64 (2:1.3.3-1+b2) ... Setting up libfontconfig1:amd64 (2.13.1-2) ... Setting up fontconfig (2.13.1-2) ... Regenerating fonts cache...done. Setting up libpango-1.0-0:amd64 (1.42.4-8~deb10u1) ... Setting up libpoppler82:amd64 (0.71.0-5+deb10u3) ... Setting up libcairo2:amd64 (1.16.0-4+deb10u1) ... Setting up poppler-utils (0.71.0-5+deb10u3) ... Setting up libpangoft2-1.0-0:amd64 (1.42.4-8~deb10u1) ... Setting up libpangocairo-1.0-0:amd64 (1.42.4-8~deb10u1) ... Setting up tesseract-ocr (4.0.0-2) ... Processing triggers for libc-bin (2.28-10+deb10u2) ... [builder 2/6] RUN pip install poetry Collecting poetry Downloading poetry-1.8.2-py3-none-any.whl (249 kB) âââââââââââââââââââââââââââââââââââââ 249.4/249.4 kB 303.7 kB/s eta 0:00:00 Collecting build<2.0.0,>=1.0.3 (from poetry) Downloading build-1.2.1-py3-none-any.whl (21 kB) Collecting cachecontrol[filecache]<0.15.0,>=0.14.0 (from poetry) Downloading cachecontrol-0.14.0-py3-none-any.whl (22 kB) Collecting cleo<3.0.0,>=2.1.0 (from poetry) Downloading cleo-2.1.0-py3-none-any.whl (78 kB) ââââââââââââââââââââââââââââââââââââââââ 78.7/78.7 kB 1.8 MB/s eta 0:00:00 Collecting crashtest<0.5.0,>=0.4.1 (from poetry) Downloading crashtest-0.4.1-py3-none-any.whl (7.6 kB) Collecting dulwich<0.22.0,>=0.21.2 (from poetry) Downloading dulwich-0.21.7-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (516 kB) âââââââââââââââââââââââââââââââââââââââ 516.4/516.4 kB 1.5 MB/s eta 0:00:00 Collecting fastjsonschema<3.0.0,>=2.18.0 (from poetry) Downloading fastjsonschema-2.19.1-py3-none-any.whl (23 kB) Collecting installer<0.8.0,>=0.7.0 (from poetry) Downloading installer-0.7.0-py3-none-any.whl (453 kB) âââââââââââââââââââââââââââââââââââââââ 453.8/453.8 kB 2.3 MB/s eta 0:00:00 Collecting keyring<25.0.0,>=24.0.0 (from poetry) Downloading keyring-24.3.1-py3-none-any.whl (38 kB) Collecting packaging>=23.1 (from poetry) Downloading packaging-24.0-py3-none-any.whl (53 kB) ââââââââââââââââââââââââââââââââââââââââ 53.5/53.5 kB 2.3 MB/s eta 0:00:00 Collecting pexpect<5.0.0,>=4.7.0 (from poetry) Downloading pexpect-4.9.0-py2.py3-none-any.whl (63 kB) ââââââââââââââââââââââââââââââââââââââââ 63.8/63.8 kB 2.2 MB/s eta 0:00:00 Collecting pkginfo<2.0.0,>=1.9.4 (from poetry) Downloading pkginfo-1.10.0-py3-none-any.whl (30 kB) Collecting platformdirs<5,>=3.0.0 (from poetry) Downloading platformdirs-4.2.0-py3-none-any.whl (17 kB) Collecting poetry-core==1.9.0 (from poetry) Downloading poetry_core-1.9.0-py3-none-any.whl (309 kB) âââââââââââââââââââââââââââââââââââââââ 309.5/309.5 kB 2.5 MB/s eta 0:00:00 Collecting poetry-plugin-export<2.0.0,>=1.6.0 (from poetry) Downloading poetry_plugin_export-1.7.1-py3-none-any.whl (10 kB) Collecting pyproject-hooks<2.0.0,>=1.0.0 (from poetry) Downloading pyproject_hooks-1.0.0-py3-none-any.whl (9.3 kB) Collecting requests<3.0,>=2.26 (from poetry) Downloading requests-2.31.0-py3-none-any.whl (62 kB) ââââââââââââââââââââââââââââââââââââââââ 62.6/62.6 kB 2.7 MB/s eta 0:00:00 Collecting requests-toolbelt<2.0.0,>=1.0.0 (from poetry) Downloading requests_toolbelt-1.0.0-py2.py3-none-any.whl (54 kB) ââââââââââââââââââââââââââââââââââââââââ 54.5/54.5 kB 1.2 MB/s eta 0:00:00 Collecting shellingham<2.0,>=1.5 (from poetry) Downloading shellingham-1.5.4-py2.py3-none-any.whl (9.8 kB) Collecting tomlkit<1.0.0,>=0.11.4 (from poetry) Downloading tomlkit-0.12.4-py3-none-any.whl (37 kB) Collecting trove-classifiers>=2022.5.19 (from poetry) Downloading trove_classifiers-2024.3.25-py3-none-any.whl (13 kB) Collecting virtualenv<21.0.0,>=20.23.0 (from poetry) Downloading virtualenv-20.25.1-py3-none-any.whl (3.8 MB) ââââââââââââââââââââââââââââââââââââââââ 3.8/3.8 MB 1.9 MB/s eta 0:00:00 Collecting msgpack<2.0.0,>=0.5.2 (from cachecontrol[filecache]<0.15.0,>=0.14.0->poetry) Downloading msgpack-1.0.8-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (409 kB) âââââââââââââââââââââââââââââââââââââââ 409.3/409.3 kB 1.7 MB/s eta 0:00:00 Collecting filelock>=3.8.0 (from cachecontrol[filecache]<0.15.0,>=0.14.0->poetry) Downloading filelock-3.13.3-py3-none-any.whl (11 kB) Collecting rapidfuzz<4.0.0,>=3.0.0 (from cleo<3.0.0,>=2.1.0->poetry) Downloading rapidfuzz-3.7.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.4 MB) ââââââââââââââââââââââââââââââââââââââââ 3.4/3.4 MB 2.2 MB/s eta 0:00:00 Collecting urllib3>=1.25 (from dulwich<0.22.0,>=0.21.2->poetry) Downloading urllib3-2.2.1-py3-none-any.whl (121 kB) âââââââââââââââââââââââââââââââââââââââ 121.1/121.1 kB 2.1 MB/s eta 0:00:00 Collecting jaraco.classes (from keyring<25.0.0,>=24.0.0->poetry) Downloading jaraco.classes-3.4.0-py3-none-any.whl (6.8 kB) Collecting importlib-metadata>=4.11.4 (from keyring<25.0.0,>=24.0.0->poetry) Downloading importlib_metadata-7.1.0-py3-none-any.whl (24 kB) Collecting SecretStorage>=3.2 (from keyring<25.0.0,>=24.0.0->poetry) Downloading SecretStorage-3.3.3-py3-none-any.whl (15 kB) Collecting jeepney>=0.4.2 (from keyring<25.0.0,>=24.0.0->poetry) Downloading jeepney-0.8.0-py3-none-any.whl (48 kB) ââââââââââââââââââââââââââââââââââââââââ 48.4/48.4 kB 2.4 MB/s eta 0:00:00 Collecting ptyprocess>=0.5 (from pexpect<5.0.0,>=4.7.0->poetry) Downloading ptyprocess-0.7.0-py2.py3-none-any.whl (13 kB) Collecting charset-normalizer<4,>=2 (from requests<3.0,>=2.26->poetry) Downloading charset_normalizer-3.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (140 kB) âââââââââââââââââââââââââââââââââââââââ 140.3/140.3 kB 1.7 MB/s eta 0:00:00 Collecting idna<4,>=2.5 (from requests<3.0,>=2.26->poetry) Downloading idna-3.6-py3-none-any.whl (61 kB) ââââââââââââââââââââââââââââââââââââââââ 61.6/61.6 kB 1.8 MB/s eta 0:00:00 Collecting certifi>=2017.4.17 (from requests<3.0,>=2.26->poetry) Downloading certifi-2024.2.2-py3-none-any.whl (163 kB) âââââââââââââââââââââââââââââââââââââââ 163.8/163.8 kB 1.9 MB/s eta 0:00:00 Collecting distlib<1,>=0.3.7 (from virtualenv<21.0.0,>=20.23.0->poetry) Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) âââââââââââââââââââââââââââââââââââââââ 468.9/468.9 kB 1.8 MB/s eta 0:00:00 Collecting zipp>=0.5 (from importlib-metadata>=4.11.4->keyring<25.0.0,>=24.0.0->poetry) Downloading zipp-3.18.1-py3-none-any.whl (8.2 kB) Collecting cryptography>=2.0 (from SecretStorage>=3.2->keyring<25.0.0,>=24.0.0->poetry) Downloading cryptography-42.0.5-cp39-abi3-manylinux_2_28_x86_64.whl (4.6 MB) ââââââââââââââââââââââââââââââââââââââââ 4.6/4.6 MB 1.7 MB/s eta 0:00:00 Collecting more-itertools (from jaraco.classes->keyring<25.0.0,>=24.0.0->poetry) Downloading more_itertools-10.2.0-py3-none-any.whl (57 kB) ââââââââââââââââââââââââââââââââââââââââ 57.0/57.0 kB 1.9 MB/s eta 0:00:00 Collecting cffi>=1.12 (from cryptography>=2.0->SecretStorage>=3.2->keyring<25.0.0,>=24.0.0->poetry) Downloading cffi-1.16.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (464 kB) âââââââââââââââââââââââââââââââââââââââ 464.8/464.8 kB 1.4 MB/s eta 0:00:00 Collecting pycparser (from cffi>=1.12->cryptography>=2.0->SecretStorage>=3.2->keyring<25.0.0,>=24.0.0->poetry) Downloading pycparser-2.22-py3-none-any.whl (117 kB) âââââââââââââââââââââââââââââââââââââââ 117.6/117.6 kB 1.4 MB/s eta 0:00:00 Installing collected packages: trove-classifiers, ptyprocess, fastjsonschema, distlib, zipp, urllib3, tomlkit, shellingham, rapidfuzz, pyproject-hooks, pycparser, poetry-core, platformdirs, pkginfo, pexpect, packaging, msgpack, more-itertools, jeepney, installer, idna, filelock, crashtest, charset-normalizer, certifi, virtualenv, requests, jaraco.classes, importlib-metadata, dulwich, cleo, cffi, build, requests-toolbelt, cryptography, cachecontrol, SecretStorage, keyring, poetry-plugin-export, poetry Successfully installed SecretStorage-3.3.3 build-1.2.1 cachecontrol-0.14.0 certifi-2024.2.2 cffi-1.16.0 charset-normalizer-3.3.2 cleo-2.1.0 crashtest-0.4.1 cryptography-42.0.5 distlib-0.3.8 dulwich-0.21.7 fastjsonschema-2.19.1 filelock-3.13.3 idna-3.6 importlib-metadata-7.1.0 installer-0.7.0 jaraco.classes-3.4.0 jeepney-0.8.0 keyring-24.3.1 more-itertools-10.2.0 msgpack-1.0.8 packaging-24.0 pexpect-4.9.0 pkginfo-1.10.0 platformdirs-4.2.0 poetry-1.8.2 poetry-core-1.9.0 poetry-plugin-export-1.7.1 ptyprocess-0.7.0 pycparser-2.22 pyproject-hooks-1.0.0 rapidfuzz-3.7.0 requests-2.31.0 requests-toolbelt-1.0.0 shellingham-1.5.4 tomlkit-0.12.4 trove-classifiers-2024.3.25 urllib3-2.2.1 virtualenv-20.25.1 zipp-3.18.1 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv [notice] A new release of pip is available: 23.1.2 -> 24.0 [notice] To update, run: pip install --upgrade pip [builder 3/6] WORKDIR /app/ [builder 4/6] ADD pyproject.toml poetry.lock ./ [builder 5/6] ADD download_embedder.py /app/ [builder 6/6] RUN --mount=type=cache,target=/tmp/poetry_cache poetry install --no-root --no-ansi --with worker,ingester --without ai,dev,api,streamlit-app Creating virtualenv redbox in /app/.venv Installing dependencies from lock file Package operations:192 installs, 1 update, 0 removals - Installing nvidia-nvjitlink-cu12 (12.4.99) - Installing filelock (3.13.1) - Installing markupsafe (2.1.5) - Installing nvidia-cublas-cu12 (12.1.3.1) - Installing mpmath (1.3.0) - Installing nvidia-cusparse-cu12 (12.1.0.106) Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file - Installing certifi (2024.2.2) - Installing fsspec (2024.2.0) - Installing charset-normalizer (3.3.2) - Installing idna (3.6) - Installing jinja2 (3.1.3) - Installing numpy (1.26.4) - Installing nvidia-cuda-nvrtc-cu12 (12.1.105) - Installing networkx (3.2.1) - Installing nvidia-cuda-cupti-cu12 (12.1.105) - Installing nvidia-cuda-runtime-cu12 (12.1.105) - Installing nvidia-cufft-cu12 (11.0.2.54) - Installing nvidia-curand-cu12 (10.3.2.106) - Installing nvidia-cudnn-cu12 (8.9.2.26) - Installing nvidia-cusolver-cu12 (11.4.5.107) - Installing nvidia-nvtx-cu12 (12.1.105) - Installing pycparser (2.21) - Installing six (1.16.0) - Installing sympy (1.12) - Installing triton (2.2.0) - Installing nvidia-nccl-cu12 (2.19.3) Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file - Installing typing-extensions (4.9.0) - Installing urllib3 (1.26.18) Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file - Installing cffi (1.16.0) - Installing contourpy (1.2.0) - Installing cycler (0.12.1) - Installing fonttools (4.49.0) - Installing kiwisolver (1.4.5) - Installing packaging (23.2) - Installing pillow (10.2.0) - Installing pyparsing (3.0.9) - Installing mdurl (0.1.2) - Installing pyyaml (6.0.1) - Installing torch (2.2.0) - Installing python-dateutil (2.8.2) - Installing tqdm (4.66.2) - Installing requests (2.31.0) - Installing annotated-types (0.6.0) - Installing antlr4-python3-runtime (4.9.3) - Installing click (8.1.7) - Installing ghp-import (2.1.0) - Installing huggingface-hub (0.20.3) - Installing cryptography (42.0.2) - Installing markdown (3.5.2) - Installing markdown-it-py (3.0.0) - Installing mergedeep (1.3.4) - Installing pathspec (0.12.1) - Installing pydantic-core (2.16.3) - Installing pygments (2.17.2) - Installing pyyaml-env-tag (0.1) - Installing torchvision (0.17.0) - Installing watchdog (4.0.0) - Installing safetensors (0.3.2) - Installing platformdirs (4.2.0) - Installing matplotlib (3.7.2) - Installing frozenlist (1.4.1) - Installing humanfriendly (10.0) - Installing jsonpointer (2.4) - Installing multidict (6.0.5) - Installing mkdocs (1.5.3) - Installing orjson (3.10.0) - Installing shellingham (1.5.4) - Installing portalocker (2.8.2) - Installing mypy-extensions (1.0.0) - Installing pypdfium2 (4.27.0) - Installing rich (13.7.1) - Installing omegaconf (2.3.0) - Installing tzdata (2024.1) - Installing pydantic (2.6.4) - Installing pdfminer-six (20221105) - Installing pycocotools (2.0.7) - Installing timm (0.9.12) - Installing pytz (2024.1) - Installing aiosignal (1.3.1) - Installing attrs (23.2.0) - Installing colorama (0.4.6) - Installing effdet (0.4.1) - Installing flatbuffers (23.5.26) - Installing iopath (0.1.10) - Installing coloredlogs (15.0.1) - Installing jsonpatch (1.33) - Installing jmespath (1.0.1) - Installing mkdocs-autorefs (1.0.1) - Installing greenlet (3.0.3) - Installing pdf2image (1.17.0) - Installing pdfplumber (0.10.4) - Installing pymdown-extensions (10.7.1) - Installing marshmallow (3.20.2) - Installing pandas (2.2.0) - Installing langsmith (0.1.39) - Installing opencv-python (4.8.0.76) - Installing pytesseract (0.3.10) - Installing protobuf (4.23.4) - Installing regex (2023.12.25) - Installing scipy (1.10.1) - Installing sniffio (1.3.1) - Installing tenacity (8.2.3) - Installing tokenizers (0.15.2) - Installing typer-slim (0.12.0) - Installing typing-inspect (0.9.0) - Installing wrapt (1.16.0) - Installing yarl (1.9.4) - Installing aiohttp (3.9.3) - Installing anyio (4.3.0) - Installing botocore (1.34.77) - Installing dataclasses-json (0.6.4) - Installing deprecated (1.2.14) - Installing babel (2.14.0) - Installing dataclasses-json-speakeasy (0.5.11) - Installing editorconfig (0.12.4) - Installing jsonpath-python (1.0.6) - Installing et-xmlfile (1.1.0) - Installing griffe (0.42.1) - Installing joblib (1.3.2) - Installing mkdocs-material-extensions (1.3.1) - Installing olefile (0.47) - Installing onnx (1.15.0) - Installing log-symbols (0.0.14) - Installing mkdocstrings (0.24.2) - Installing layoutparser (0.3.4) - Installing langchain-core (0.1.39) - Installing lxml (5.1.0) Installing /app/.venv/lib/python3.11/site-packages/dataclasses_json/__version__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/dataclasses_json/api.py over existing file Installing /app/.venv/lib/python3.11/site-packages/dataclasses_json/cfg.py over existing file Installing /app/.venv/lib/python3.11/site-packages/dataclasses_json/core.py over existing file - Installing onnxruntime (1.15.1) Installing /app/.venv/lib/python3.11/site-packages/dataclasses_json/mm.py over existing file - Installing paginate (0.5.6) Installing /app/.venv/lib/python3.11/site-packages/dataclasses_json/py.typed over existing file - Installing python-multipart (0.0.9) Installing /app/.venv/lib/python3.11/site-packages/dataclasses_json/stringcase.py over existing file - Installing rapidfuzz (3.6.1) Installing /app/.venv/lib/python3.11/site-packages/dataclasses_json/undefined.py over existing file Installing /app/.venv/lib/python3.11/site-packages/dataclasses_json/utils.py over existing file - Installing soupsieve (2.5) - Installing spinners (0.0.24) - Installing sqlalchemy (2.0.29) - Installing termcolor (2.4.0) - Installing threadpoolctl (3.4.0) - Installing transformers (4.37.1) - Installing typer-cli (0.12.0) - Installing xlsxwriter (3.1.9) - Installing zipp (3.17.0) - Installing backoff (2.2.1) - Installing beautifulsoup4 (4.12.3) - Installing bump2version (1.0.1) - Installing emoji (2.10.1) - Installing elastic-transport (8.13.0) - Installing fast-depends (2.4.2) - Installing filetype (1.2.0) - Installing chardet (5.2.0) - Installing importlib-resources (6.1.1) - Installing jsbeautifier (1.15.1) - Installing importlib-metadata (7.0.1) - Installing langdetect (1.0.9) - Installing halo (0.0.31) - Installing langchain-community (0.0.31) - Installing nltk (3.8.1) - Installing openpyxl (3.1.2) - Installing mkdocs-material (9.5.17) - Installing langchain-text-splitters (0.0.1) - Installing mkdocstrings-python (1.9.2) - Installing msg-parser (1.2.0) - Installing pikepdf (8.11.0) - Installing pillow-heif (0.15.0) - Installing pypandoc (1.12) - Installing pypdf (4.0.1) - Installing python-docx (1.1.0) - Installing python-dotenv (1.0.1) - Installing python-iso639 (2024.2.7) - Installing python-magic (0.4.27) - Installing python-pptx (0.6.23) - Installing redis (5.0.3) - Installing s3transfer (0.10.1) - Installing scikit-learn (1.4.1.post1) - Updating setuptools (69.1.0 -> 69.2.0) - Installing tabulate (0.9.0) - Installing typer (0.12.0) - Installing unstructured-client (0.18.0) - Installing unstructured-inference (0.7.25) - Installing unstructured-pytesseract (0.3.12) - Installing xlrd (2.0.1) Installing /app/.venv/bin/pytesseract over existing file - Installing boto3 (1.34.77) - Installing bumpversion (0.6.0) - Installing elasticsearch (8.13.0) - Installing faststream (0.4.7) - Installing langchain (0.1.14) - Installing mkapi (2.1.0) - Installing opencv-python-headless (4.9.0.80) - Installing markdown-mdantic (2.1.0) - Installing sentence-transformers (2.6.1) - Installing pika (1.3.2) - Installing pydantic-settings (2.2.1) - Installing mkdocs-mermaid2-plugin (1.1.1) - Installing unstructured (0.13.0) - Installing tiktoken (0.6.0) Installing /app/.venv/lib/python3.11/site-packages/cv2/LICENSE-3RD-PARTY.txt over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/LICENSE.txt over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/py.typed over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/load_config_py2.py over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/load_config_py3.py over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/cv2.abi3.so over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/config-3.py over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/config.py over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/version.py over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/samples/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/utils/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/utils/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/utils/nested/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/utils/fs/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/misc/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/misc/version.py over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/data/haarcascade_frontalcatface_extended.xml over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/data/haarcascade_frontalface_default.xml over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/data/haarcascade_profileface.xml over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/data/haarcascade_upperbody.xml over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/data/haarcascade_lowerbody.xml over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/data/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/data/haarcascade_license_plate_rus_16stages.xml over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/data/haarcascade_eye_tree_eyeglasses.xml over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/data/haarcascade_righteye_2splits.xml over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/data/haarcascade_russian_plate_number.xml over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/data/haarcascade_frontalface_alt_tree.xml over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/data/haarcascade_eye.xml over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/data/haarcascade_frontalface_alt2.xml over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/data/haarcascade_smile.xml over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/data/haarcascade_frontalface_alt.xml over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/data/haarcascade_fullbody.xml over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/data/haarcascade_lefteye_2splits.xml over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/data/haarcascade_frontalcatface.xml over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/Error/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/dnn/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/cuda/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/parallel/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/ml/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/ocl/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/videoio_registry/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/ipp/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/mat_wrapper/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/ogl/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/typing/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/barcode/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/gapi/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/gapi/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/gapi/ov/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/gapi/core/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/gapi/core/ocl/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/gapi/core/cpu/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/gapi/core/fluid/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/gapi/wip/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/gapi/wip/onevpl/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/gapi/wip/draw/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/gapi/wip/gst/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/gapi/render/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/gapi/render/ocv/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/gapi/oak/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/gapi/ie/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/gapi/ie/detail/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/gapi/video/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/gapi/onnx/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/gapi/streaming/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/gapi/own/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/gapi/own/detail/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/gapi/imgproc/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/gapi/imgproc/fluid/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/detail/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/flann/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/segmentation/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/fisheye/__init__.pyi over existing file Installing /app/.venv/lib/python3.11/site-packages/cv2/aruco/__init__.pyi over existing file ```

core-api

```markdown [internal] load build definition from Dockerfile transferring 1037/0 0.003 [internal] load metadata for docker.io/library/python:3.11-slim-buster [internal] load metadata for docker.io/library/python:3.11-buster [internal] load .dockerignore [builder 1/6] FROM docker.io/library/python:3.11-buster@sha256:3a19b4d6ce4402d11bb19aa11416e4a262a60a57707a5cda5787a81285df2666 resolve docker.io/library/python:3.11-buster@sha256:3a19b4d6ce4402d11bb19aa11416e4a262a60a57707a5cda5787a81285df2666 0/0 0.024 done 988/988 -0.345 done 2007/2007 -0.234 done 7522/7522 -0.073 done 17579218/17579218 77.3 done 50448512/50448512 88.973 done 6147835/6147835 99.867 done 51870721/51870721 103.847 done 244/244 104.012 done 3089898/3089898 106.163 done 22309962/22309962 113.162 done 191876389/191876389 153.408 extract 0/0 3.868 extract 0/0 0.804 extract 0/0 4.02 extract 0/0 10.038 extract 0/0 0.427 extract 0/0 0.986 extract 0/0 0 extract 0/0 0.414 [runtime 1/8] FROM docker.io/library/python:3.11-slim-buster@sha256:c46b0ae5728c2247b99903098ade3176a58e274d9c7d2efeaaab3e0621a53935 resolve docker.io/library/python:3.11-slim-buster@sha256:c46b0ae5728c2247b99903098ade3176a58e274d9c7d2efeaaab3e0621a53935 0/0 0.023 done 988/988 -0.412 done 1370/1370 -0.288 done 6834/6834 -0.116 done 27138450/27138450 53.333 done 2781342/2781342 53.691 done 244/244 53.832 done 3380069/3380069 55.495 done 11996761/11996761 58.553 extract 0/0 2.513 extract 0/0 0.221 extract 0/0 0.75 extract 0/0 0 extract 0/0 0.441 [internal] load build context transferring 827050/0 0.05 [runtime 2/7] WORKDIR /app/ [builder 2/6] WORKDIR /app/ [builder 3/8] RUN pip install poetry Collecting poetry Downloading poetry-1.8.2-py3-none-any.whl (249 kB) âââââââââââââââââââââââââââââââââââââ 249.4/249.4 kB 516.2 kB/s eta 0:00:00 Collecting build<2.0.0,>=1.0.3 (from poetry) Downloading build-1.2.1-py3-none-any.whl (21 kB) Collecting cachecontrol[filecache]<0.15.0,>=0.14.0 (from poetry) Downloading cachecontrol-0.14.0-py3-none-any.whl (22 kB) Collecting cleo<3.0.0,>=2.1.0 (from poetry) Downloading cleo-2.1.0-py3-none-any.whl (78 kB) âââââââââââââââââââââââââââââââââââââââ 78.7/78.7 kB 857.1 kB/s eta 0:00:00 Collecting crashtest<0.5.0,>=0.4.1 (from poetry) Downloading crashtest-0.4.1-py3-none-any.whl (7.6 kB) Collecting dulwich<0.22.0,>=0.21.2 (from poetry) Downloading dulwich-0.21.7-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (516 kB) âââââââââââââââââââââââââââââââââââââ 516.4/516.4 kB 892.7 kB/s eta 0:00:00 Collecting fastjsonschema<3.0.0,>=2.18.0 (from poetry) Downloading fastjsonschema-2.19.1-py3-none-any.whl (23 kB) Collecting installer<0.8.0,>=0.7.0 (from poetry) Downloading installer-0.7.0-py3-none-any.whl (453 kB) âââââââââââââââââââââââââââââââââââââââ 453.8/453.8 kB 1.2 MB/s eta 0:00:00 Collecting keyring<25.0.0,>=24.0.0 (from poetry) Downloading keyring-24.3.1-py3-none-any.whl (38 kB) Collecting packaging>=23.1 (from poetry) Downloading packaging-24.0-py3-none-any.whl (53 kB) ââââââââââââââââââââââââââââââââââââââââ 53.5/53.5 kB 1.1 MB/s eta 0:00:00 Collecting pexpect<5.0.0,>=4.7.0 (from poetry) Downloading pexpect-4.9.0-py2.py3-none-any.whl (63 kB) ââââââââââââââââââââââââââââââââââââââââ 63.8/63.8 kB 1.2 MB/s eta 0:00:00 Collecting pkginfo<2.0.0,>=1.9.4 (from poetry) Downloading pkginfo-1.10.0-py3-none-any.whl (30 kB) Collecting platformdirs<5,>=3.0.0 (from poetry) Downloading platformdirs-4.2.0-py3-none-any.whl (17 kB) Collecting poetry-core==1.9.0 (from poetry) Downloading poetry_core-1.9.0-py3-none-any.whl (309 kB) âââââââââââââââââââââââââââââââââââââââ 309.5/309.5 kB 1.3 MB/s eta 0:00:00 Collecting poetry-plugin-export<2.0.0,>=1.6.0 (from poetry) Downloading poetry_plugin_export-1.7.1-py3-none-any.whl (10 kB) Collecting pyproject-hooks<2.0.0,>=1.0.0 (from poetry) Downloading pyproject_hooks-1.0.0-py3-none-any.whl (9.3 kB) Collecting requests<3.0,>=2.26 (from poetry) Downloading requests-2.31.0-py3-none-any.whl (62 kB) ââââââââââââââââââââââââââââââââââââââââ 62.6/62.6 kB 1.5 MB/s eta 0:00:00 Collecting requests-toolbelt<2.0.0,>=1.0.0 (from poetry) Downloading requests_toolbelt-1.0.0-py2.py3-none-any.whl (54 kB) ââââââââââââââââââââââââââââââââââââââââ 54.5/54.5 kB 1.0 MB/s eta 0:00:00 Collecting shellingham<2.0,>=1.5 (from poetry) Downloading shellingham-1.5.4-py2.py3-none-any.whl (9.8 kB) Collecting tomlkit<1.0.0,>=0.11.4 (from poetry) Downloading tomlkit-0.12.4-py3-none-any.whl (37 kB) Collecting trove-classifiers>=2022.5.19 (from poetry) Downloading trove_classifiers-2024.3.25-py3-none-any.whl (13 kB) Collecting virtualenv<21.0.0,>=20.23.0 (from poetry) Downloading virtualenv-20.25.1-py3-none-any.whl (3.8 MB) ââââââââââââââââââââââââââââââââââââââââ 3.8/3.8 MB 1.2 MB/s eta 0:00:00 Collecting msgpack<2.0.0,>=0.5.2 (from cachecontrol[filecache]<0.15.0,>=0.14.0->poetry) Downloading msgpack-1.0.8-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (409 kB) âââââââââââââââââââââââââââââââââââââââ 409.3/409.3 kB 2.1 MB/s eta 0:00:00 Collecting filelock>=3.8.0 (from cachecontrol[filecache]<0.15.0,>=0.14.0->poetry) Downloading filelock-3.13.3-py3-none-any.whl (11 kB) Collecting rapidfuzz<4.0.0,>=3.0.0 (from cleo<3.0.0,>=2.1.0->poetry) Downloading rapidfuzz-3.7.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.4 MB) ââââââââââââââââââââââââââââââââââââââââ 3.4/3.4 MB 1.4 MB/s eta 0:00:00 Collecting urllib3>=1.25 (from dulwich<0.22.0,>=0.21.2->poetry) Downloading urllib3-2.2.1-py3-none-any.whl (121 kB) âââââââââââââââââââââââââââââââââââââââ 121.1/121.1 kB 1.2 MB/s eta 0:00:00 Collecting jaraco.classes (from keyring<25.0.0,>=24.0.0->poetry) Downloading jaraco.classes-3.4.0-py3-none-any.whl (6.8 kB) Collecting importlib-metadata>=4.11.4 (from keyring<25.0.0,>=24.0.0->poetry) Downloading importlib_metadata-7.1.0-py3-none-any.whl (24 kB) Collecting SecretStorage>=3.2 (from keyring<25.0.0,>=24.0.0->poetry) Downloading SecretStorage-3.3.3-py3-none-any.whl (15 kB) Collecting jeepney>=0.4.2 (from keyring<25.0.0,>=24.0.0->poetry) Downloading jeepney-0.8.0-py3-none-any.whl (48 kB) ââââââââââââââââââââââââââââââââââââââââ 48.4/48.4 kB 1.5 MB/s eta 0:00:00 Collecting ptyprocess>=0.5 (from pexpect<5.0.0,>=4.7.0->poetry) Downloading ptyprocess-0.7.0-py2.py3-none-any.whl (13 kB) Collecting charset-normalizer<4,>=2 (from requests<3.0,>=2.26->poetry) Downloading charset_normalizer-3.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (140 kB) âââââââââââââââââââââââââââââââââââââââ 140.3/140.3 kB 1.4 MB/s eta 0:00:00 Collecting idna<4,>=2.5 (from requests<3.0,>=2.26->poetry) Downloading idna-3.6-py3-none-any.whl (61 kB) ââââââââââââââââââââââââââââââââââââââââ 61.6/61.6 kB 2.1 MB/s eta 0:00:00 Collecting certifi>=2017.4.17 (from requests<3.0,>=2.26->poetry) Downloading certifi-2024.2.2-py3-none-any.whl (163 kB) âââââââââââââââââââââââââââââââââââââââ 163.8/163.8 kB 1.4 MB/s eta 0:00:00 Collecting distlib<1,>=0.3.7 (from virtualenv<21.0.0,>=20.23.0->poetry) Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) âââââââââââââââââââââââââââââââââââââââ 468.9/468.9 kB 1.2 MB/s eta 0:00:00 Collecting zipp>=0.5 (from importlib-metadata>=4.11.4->keyring<25.0.0,>=24.0.0->poetry) Downloading zipp-3.18.1-py3-none-any.whl (8.2 kB) Collecting cryptography>=2.0 (from SecretStorage>=3.2->keyring<25.0.0,>=24.0.0->poetry) Downloading cryptography-42.0.5-cp39-abi3-manylinux_2_28_x86_64.whl (4.6 MB) ââââââââââââââââââââââââââââââââââââââââ 4.6/4.6 MB 1.5 MB/s eta 0:00:00 Collecting more-itertools (from jaraco.classes->keyring<25.0.0,>=24.0.0->poetry) Downloading more_itertools-10.2.0-py3-none-any.whl (57 kB) ââââââââââââââââââââââââââââââââââââââââ 57.0/57.0 kB 1.8 MB/s eta 0:00:00 Collecting cffi>=1.12 (from cryptography>=2.0->SecretStorage>=3.2->keyring<25.0.0,>=24.0.0->poetry) Downloading cffi-1.16.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (464 kB) âââââââââââââââââââââââââââââââââââââââ 464.8/464.8 kB 2.7 MB/s eta 0:00:00 Collecting pycparser (from cffi>=1.12->cryptography>=2.0->SecretStorage>=3.2->keyring<25.0.0,>=24.0.0->poetry) Downloading pycparser-2.22-py3-none-any.whl (117 kB) âââââââââââââââââââââââââââââââââââââââ 117.6/117.6 kB 1.6 MB/s eta 0:00:00 Installing collected packages: trove-classifiers, ptyprocess, fastjsonschema, distlib, zipp, urllib3, tomlkit, shellingham, rapidfuzz, pyproject-hooks, pycparser, poetry-core, platformdirs, pkginfo, pexpect, packaging, msgpack, more-itertools, jeepney, installer, idna, filelock, crashtest, charset-normalizer, certifi, virtualenv, requests, jaraco.classes, importlib-metadata, dulwich, cleo, cffi, build, requests-toolbelt, cryptography, cachecontrol, SecretStorage, keyring, poetry-plugin-export, poetry Successfully installed SecretStorage-3.3.3 build-1.2.1 cachecontrol-0.14.0 certifi-2024.2.2 cffi-1.16.0 charset-normalizer-3.3.2 cleo-2.1.0 crashtest-0.4.1 cryptography-42.0.5 distlib-0.3.8 dulwich-0.21.7 fastjsonschema-2.19.1 filelock-3.13.3 idna-3.6 importlib-metadata-7.1.0 installer-0.7.0 jaraco.classes-3.4.0 jeepney-0.8.0 keyring-24.3.1 more-itertools-10.2.0 msgpack-1.0.8 packaging-24.0 pexpect-4.9.0 pkginfo-1.10.0 platformdirs-4.2.0 poetry-1.8.2 poetry-core-1.9.0 poetry-plugin-export-1.7.1 ptyprocess-0.7.0 pycparser-2.22 pyproject-hooks-1.0.0 rapidfuzz-3.7.0 requests-2.31.0 requests-toolbelt-1.0.0 shellingham-1.5.4 tomlkit-0.12.4 trove-classifiers-2024.3.25 urllib3-2.2.1 virtualenv-20.25.1 zipp-3.18.1 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv [notice] A new release of pip is available: 23.1.2 -> 24.0 [notice] To update, run: pip install --upgrade pip [builder 4/8] ADD redbox/ /app/redbox [builder 5/8] ADD pyproject.toml poetry.lock /app/ [builder 6/8] ADD download_embedder.py /app/ [builder 7/8] ADD redbox/ /app/redbox [builder 8/8] RUN --mount=type=cache,target=/tmp/poetry_cache poetry install --no-root --no-ansi --with api --without ai,ingester,dev,worker,streamlit-app Creating virtualenv redbox in /app/.venv Installing dependencies from lock file Package operations: 129 installs, 1 update, 0 removals - Installing six (1.16.0) - Installing markupsafe (2.1.5) - Installing mdurl (0.1.2) - Installing python-dateutil (2.8.2) - Installing pyyaml (6.0.1) - Installing typing-extensions (4.9.0) - Installing annotated-types (0.6.0) - Installing certifi (2024.2.2) - Installing charset-normalizer (3.3.2) - Installing ghp-import (2.1.0) - Installing click (8.1.7) - Installing jinja2 (3.1.3) - Installing markdown (3.5.2) - Installing idna (3.6) - Installing markdown-it-py (3.0.0) - Installing pathspec (0.12.1) - Installing platformdirs (4.2.0) - Installing packaging (23.2) - Installing pydantic-core (2.16.3) - Installing mergedeep (1.3.4) - Installing pygments (2.17.2) - Installing pyyaml-env-tag (0.1) - Installing urllib3 (1.26.18) - Installing watchdog (4.0.0) - Installing filelock (3.13.1) - Installing frozenlist (1.4.1) - Installing fsspec (2024.2.0) - Installing mkdocs (1.5.3) - Installing multidict (6.0.5) - Installing nvidia-nvjitlink-cu12 (12.4.99) - Installing orjson (3.10.0) - Installing mypy-extensions (1.0.0) - Installing rich (13.7.1) - Installing shellingham (1.5.4) - Installing pydantic (2.6.4) - Installing jsonpointer (2.4) - Installing requests (2.31.0) - Installing tqdm (4.66.2) - Installing aiosignal (1.3.1) - Installing attrs (23.2.0) - Installing colorama (0.4.6) - Installing huggingface-hub (0.20.3) - Installing greenlet (3.0.3) - Installing jsonpatch (1.33) - Installing jmespath (1.0.1) - Installing mkdocs-autorefs (1.0.1) - Installing mpmath (1.3.0) - Installing marshmallow (3.20.2) - Installing nvidia-cusparse-cu12 (12.1.0.106) - Installing pymdown-extensions (10.7.1) - Installing numpy (1.26.4) - Installing langsmith (0.1.39) - Installing typer-slim (0.12.0) - Installing yarl (1.9.4) - Installing nvidia-cublas-cu12 (12.1.3.1) - Installing typing-inspect (0.9.0) - Installing tenacity (8.2.3) - Installing sniffio (1.3.1) Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file - Installing aiohttp (3.9.3) - Installing anyio (4.3.0) - Installing botocore (1.34.77) - Installing dataclasses-json (0.6.4) - Installing griffe (0.42.1) - Installing joblib (1.3.2) - Installing log-symbols (0.0.14) - Installing mkdocs-material-extensions (1.3.1) - Installing langchain-core (0.1.39) - Installing editorconfig (0.12.4) - Installing nvidia-cuda-cupti-cu12 (12.1.105) - Installing mkdocstrings (0.24.2) - Installing networkx (3.2.1) - Installing nvidia-cudnn-cu12 (8.9.2.26) - Installing nvidia-curand-cu12 (10.3.2.106) - Installing babel (2.14.0) - Installing nvidia-cuda-runtime-cu12 (12.1.105) - Installing nvidia-cusolver-cu12 (11.4.5.107) - Installing nvidia-cufft-cu12 (11.0.2.54) - Installing nvidia-cuda-nvrtc-cu12 (12.1.105) Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file - Installing nvidia-nccl-cu12 (2.19.3) - Installing nvidia-nvtx-cu12 (12.1.105) Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file - Installing paginate (0.5.6) - Installing regex (2023.12.25) - Installing safetensors (0.3.2) - Installing scipy (1.10.1) - Installing soupsieve (2.5) - Installing spinners (0.0.24) - Installing sqlalchemy (2.0.29) - Installing sympy (1.12) - Installing termcolor (2.4.0) - Installing threadpoolctl (3.4.0) - Installing tokenizers (0.15.2) - Installing triton (2.2.0) - Installing typer-cli (0.12.0) Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file - Installing beautifulsoup4 (4.12.3) - Installing bump2version (1.0.1) - Installing elastic-transport (8.13.0) - Installing h11 (0.14.0) - Installing halo (0.0.31) - Installing fast-depends (2.4.2) - Installing langchain-text-splitters (0.0.1) - Installing mkdocstrings-python (1.9.2) - Installing pillow (10.2.0) - Installing langchain-community (0.0.31) - Installing s3transfer (0.10.1) - Updating setuptools (69.1.0 -> 69.2.0) - Installing mkdocs-material (9.5.17) - Installing tabulate (0.9.0) - Installing python-dotenv (1.0.1) - Installing scikit-learn (1.4.1.post1) - Installing jsbeautifier (1.15.1) - Installing torch (2.2.0) - Installing starlette (0.37.2) - Installing redis (5.0.3) - Installing transformers (4.37.1) - Installing typer (0.12.0) - Installing boto3 (1.34.77) - Installing bumpversion (0.6.0) - Installing elasticsearch (8.13.0) - Installing faststream (0.4.7) - Installing fastapi (0.110.1) - Installing mkapi (2.1.0) - Installing pika (1.3.2) - Installing pydantic-settings (2.2.1) - Installing sentence-transformers (2.6.1) - Installing tiktoken (0.6.0) - Installing uvicorn (0.29.0) - Installing python-multipart (0.0.9) - Installing mkdocs-mermaid2-plugin (1.1.1) - Installing markdown-mdantic (2.1.0) - Installing langchain (0.1.14) [runtime 3/7] COPY --from=builder /app/.venv /app/.venv [runtime 4/7] ADD core_api/src/app.py /app/app.py [runtime 5/7] ADD download_embedder.py /app/ [runtime 6/7] ADD redbox/ /app/redbox [runtime 7/7] RUN type=cache python download_embedder.py --model_name all-mpnet-base-v2 /app/.venv/lib/python3.11/site-packages/pydantic/_internal/_fields.py:151: UserWarning: Field "model_info" has conflict with protected namespace "model_". You may be able to resolve this warning by setting `model_config['protected_namespaces'] = ()`. warnings.warn( INFO:root:ð¾ Downloading Sentence Transformer Embedder: all-mpnet-base-v2 INFO:sentence_transformers.SentenceTransformer:Load pretrained SentenceTransformer: all-mpnet-base-v2 modules.json: 0%| | 0.00/349 [00:00

streamlit-app

```markdown [internal] load build definition from Dockerfile transferring 1018/0 0.003 [internal] load metadata for docker.io/library/python:3.11-slim-buster [internal] load metadata for docker.io/library/python:3.11-buster [internal] load .dockerignore [builder 1/6] FROM docker.io/library/python:3.11-buster@sha256:3a19b4d6ce4402d11bb19aa11416e4a262a60a57707a5cda5787a81285df2666 resolve docker.io/library/python:3.11-buster@sha256:3a19b4d6ce4402d11bb19aa11416e4a262a60a57707a5cda5787a81285df2666 0/0 0.024 done 988/988 -0.345 done 2007/2007 -0.234 done 7522/7522 -0.073 done 17579218/17579218 77.3 done 50448512/50448512 88.973 done 6147835/6147835 99.867 done 51870721/51870721 103.847 done 244/244 104.012 done 3089898/3089898 106.163 done 22309962/22309962 113.162 done 191876389/191876389 153.408 extract 0/0 3.868 extract 0/0 0.804 extract 0/0 4.02 extract 0/0 10.038 extract 0/0 0.427 extract 0/0 0.986 extract 0/0 0 extract 0/0 0.414 [runtime 1/8] FROM docker.io/library/python:3.11-slim-buster@sha256:c46b0ae5728c2247b99903098ade3176a58e274d9c7d2efeaaab3e0621a53935 resolve docker.io/library/python:3.11-slim-buster@sha256:c46b0ae5728c2247b99903098ade3176a58e274d9c7d2efeaaab3e0621a53935 0/0 0.023 done 988/988 -0.412 done 1370/1370 -0.288 done 6834/6834 -0.116 done 27138450/27138450 53.333 done 2781342/2781342 53.691 done 244/244 53.832 done 3380069/3380069 55.495 done 11996761/11996761 58.553 extract 0/0 2.513 extract 0/0 0.221 extract 0/0 0.75 extract 0/0 0 extract 0/0 0.441 [internal] load build context transferring 877051/0 0.057 [runtime 2/9] RUN apt-get update Get:1 http://deb.debian.org/debian buster InRelease [122 kB] Get:2 http://deb.debian.org/debian-security buster/updates InRelease [34.8 kB] Get:3 http://deb.debian.org/debian buster-updates InRelease [56.6 kB] Get:4 http://deb.debian.org/debian buster/main amd64 Packages [7909 kB] Get:5 http://deb.debian.org/debian-security buster/updates/main amd64 Packages [592 kB] Get:6 http://deb.debian.org/debian buster-updates/main amd64 Packages [8788 B] Fetched 8723 kB in 4s (2011 kB/s) Reading package lists... [runtime 3/9] RUN apt-get install -y libgl-dev libmagic-dev inetutils-ping Reading package lists... Building dependency tree... Reading state information... The following additional packages will be installed: libbsd0 libdrm-amdgpu1 libdrm-common libdrm-dev libdrm-intel1 libdrm-nouveau2 libdrm-radeon1 libdrm2 libedit2 libegl-mesa0 libegl1 libelf1 libgbm1 libgl1 libgl1-mesa-dri libglapi-mesa libgles1 libgles2 libglvnd-core-dev libglvnd-dev libglvnd0 libglx-mesa0 libglx0 libidn11 libllvm7 libmagic-mgc libmagic1 libopengl0 libpciaccess0 libpthread-stubs0-dev libsensors-config libsensors5 libwayland-client0 libwayland-server0 libx11-6 libx11-data libx11-dev libx11-xcb-dev libx11-xcb1 libxau-dev libxau6 libxcb-dri2-0 libxcb-dri2-0-dev libxcb-dri3-0 libxcb-dri3-dev libxcb-glx0 libxcb-glx0-dev libxcb-present-dev libxcb-present0 libxcb-randr0 libxcb-randr0-dev libxcb-render0 libxcb-render0-dev libxcb-shape0 libxcb-shape0-dev libxcb-sync-dev libxcb-sync1 libxcb-xfixes0 libxcb-xfixes0-dev libxcb1 libxcb1-dev libxdamage-dev libxdamage1 libxdmcp-dev libxdmcp6 libxext-dev libxext6 libxfixes-dev libxfixes3 libxshmfence-dev libxshmfence1 libxxf86vm-dev libxxf86vm1 mesa-common-dev x11proto-core-dev x11proto-damage-dev x11proto-dev x11proto-fixes-dev x11proto-xext-dev x11proto-xf86vidmode-dev xorg-sgml-doctools xtrans-dev Suggested packages: file pciutils lm-sensors libx11-doc libxcb-doc libxext-doc The following NEW packages will be installed: inetutils-ping libbsd0 libdrm-amdgpu1 libdrm-common libdrm-dev libdrm-intel1 libdrm-nouveau2 libdrm-radeon1 libdrm2 libedit2 libegl-mesa0 libegl1 libelf1 libgbm1 libgl1 libgl1-mesa-dev libgl1-mesa-dri libglapi-mesa libgles1 libgles2 libglvnd-core-dev libglvnd-dev libglvnd0 libglx-mesa0 libglx0 libidn11 libllvm7 libmagic-dev libmagic-mgc libmagic1 libopengl0 libpciaccess0 libpthread-stubs0-dev libsensors-config libsensors5 libwayland-client0 libwayland-server0 libx11-6 libx11-data libx11-dev libx11-xcb-dev libx11-xcb1 libxau-dev libxau6 libxcb-dri2-0 libxcb-dri2-0-dev libxcb-dri3-0 libxcb-dri3-dev libxcb-glx0 libxcb-glx0-dev libxcb-present-dev libxcb-present0 libxcb-randr0 libxcb-randr0-dev libxcb-render0 libxcb-render0-dev libxcb-shape0 libxcb-shape0-dev libxcb-sync-dev libxcb-sync1 libxcb-xfixes0 libxcb-xfixes0-dev libxcb1 libxcb1-dev libxdamage-dev libxdamage1 libxdmcp-dev libxdmcp6 libxext-dev libxext6 libxfixes-dev libxfixes3 libxshmfence-dev libxshmfence1 libxxf86vm-dev libxxf86vm1 mesa-common-dev x11proto-core-dev x11proto-damage-dev x11proto-dev x11proto-fixes-dev x11proto-xext-dev x11proto-xf86vidmode-dev xorg-sgml-doctools xtrans-dev 0 upgraded, 85 newly installed, 0 to remove and 12 not upgraded. Need to get 28.1 MB of archives. After this operation, 241 MB of additional disk space will be used. Get:1 http://deb.debian.org/debian buster/main amd64 libbsd0 amd64 0.9.1-2+deb10u1 [99.5 kB] Get:2 http://deb.debian.org/debian buster/main amd64 libdrm-common all 2.4.97-1 [13.8 kB] Get:3 http://deb.debian.org/debian buster/main amd64 libdrm2 amd64 2.4.97-1 [39.7 kB] Get:4 http://deb.debian.org/debian buster/main amd64 libdrm-amdgpu1 amd64 2.4.97-1 [27.3 kB] Get:5 http://deb.debian.org/debian buster/main amd64 libpciaccess0 amd64 0.14-1 [53.5 kB] Get:6 http://deb.debian.org/debian buster/main amd64 libdrm-intel1 amd64 2.4.97-1 [69.8 kB] Get:7 http://deb.debian.org/debian buster/main amd64 libdrm-radeon1 amd64 2.4.97-1 [31.1 kB] Get:8 http://deb.debian.org/debian buster/main amd64 libdrm-nouveau2 amd64 2.4.97-1 [26.3 kB] Get:9 http://deb.debian.org/debian buster/main amd64 libdrm-dev amd64 2.4.97-1 [131 kB] Get:10 http://deb.debian.org/debian buster/main amd64 libedit2 amd64 3.1-20181209-1 [94.0 kB] Get:11 http://deb.debian.org/debian buster/main amd64 libwayland-server0 amd64 1.16.0-1 [32.5 kB] Get:12 http://deb.debian.org/debian buster/main amd64 libgbm1 amd64 18.3.6-2+deb10u1 [67.8 kB] Get:13 http://deb.debian.org/debian buster/main amd64 libglapi-mesa amd64 18.3.6-2+deb10u1 [66.3 kB] Get:14 http://deb.debian.org/debian buster/main amd64 libwayland-client0 amd64 1.16.0-1 [26.4 kB] Get:15 http://deb.debian.org/debian-security buster/updates/main amd64 libx11-xcb1 amd64 2:1.6.7-1+deb10u4 [191 kB] Get:16 http://deb.debian.org/debian buster/main amd64 libxau6 amd64 1:1.0.8-1+b2 [19.9 kB] Get:17 http://deb.debian.org/debian buster/main amd64 libxdmcp6 amd64 1:1.1.2-3 [26.3 kB] Get:18 http://deb.debian.org/debian buster/main amd64 libxcb1 amd64 1.13.1-2 [137 kB] Get:19 http://deb.debian.org/debian buster/main amd64 libxcb-dri2-0 amd64 1.13.1-2 [101 kB] Get:20 http://deb.debian.org/debian buster/main amd64 libxcb-dri3-0 amd64 1.13.1-2 [100 kB] Get:21 http://deb.debian.org/debian buster/main amd64 libxcb-present0 amd64 1.13.1-2 [99.1 kB] Get:22 http://deb.debian.org/debian buster/main amd64 libxcb-sync1 amd64 1.13.1-2 [103 kB] Get:23 http://deb.debian.org/debian buster/main amd64 libxcb-xfixes0 amd64 1.13.1-2 [103 kB] Get:24 http://deb.debian.org/debian buster/main amd64 libxshmfence1 amd64 1.3-1 [8820 B] Get:25 http://deb.debian.org/debian buster/main amd64 libegl-mesa0 amd64 18.3.6-2+deb10u1 [135 kB] Get:26 http://deb.debian.org/debian-security buster/updates/main amd64 libelf1 amd64 0.176-1.1+deb10u1 [161 kB] Get:27 http://deb.debian.org/debian-security buster/updates/main amd64 libx11-data all 2:1.6.7-1+deb10u4 [299 kB] Get:28 http://deb.debian.org/debian-security buster/updates/main amd64 libx11-6 amd64 2:1.6.7-1+deb10u4 [758 kB] Get:29 http://deb.debian.org/debian buster/main amd64 xorg-sgml-doctools all 1:1.11-1 [21.9 kB] Get:30 http://deb.debian.org/debian buster/main amd64 x11proto-dev all 2018.4-4 [251 kB] Get:31 http://deb.debian.org/debian buster/main amd64 x11proto-core-dev all 2018.4-4 [3128 B] Get:32 http://deb.debian.org/debian buster/main amd64 libxau-dev amd64 1:1.0.8-1+b2 [23.1 kB] Get:33 http://deb.debian.org/debian buster/main amd64 libxdmcp-dev amd64 1:1.1.2-3 [42.2 kB] Get:34 http://deb.debian.org/debian buster/main amd64 xtrans-dev all 1.3.5-1 [100 kB] Get:35 http://deb.debian.org/debian buster/main amd64 libpthread-stubs0-dev amd64 0.4-1 [5344 B] Get:36 http://deb.debian.org/debian buster/main amd64 libxcb1-dev amd64 1.13.1-2 [174 kB] Get:37 http://deb.debian.org/debian-security buster/updates/main amd64 libx11-dev amd64 2:1.6.7-1+deb10u4 [826 kB] Get:38 http://deb.debian.org/debian buster/main amd64 mesa-common-dev amd64 18.3.6-2+deb10u1 [611 kB] Get:39 http://deb.debian.org/debian buster/main amd64 libglvnd0 amd64 1.1.0-1 [48.6 kB] Get:40 http://deb.debian.org/debian buster/main amd64 libglvnd-core-dev amd64 1.1.0-1 [13.2 kB] Get:41 http://deb.debian.org/debian buster/main amd64 libegl1 amd64 1.1.0-1 [33.6 kB] Get:42 http://deb.debian.org/debian buster/main amd64 libgles1 amd64 1.1.0-1 [13.8 kB] Get:43 http://deb.debian.org/debian buster/main amd64 libgles2 amd64 1.1.0-1 [19.0 kB] Get:44 http://deb.debian.org/debian buster/main amd64 libxext6 amd64 2:1.3.3-1+b2 [52.5 kB] Get:45 http://deb.debian.org/debian buster/main amd64 libxcb-glx0 amd64 1.13.1-2 [116 kB] Get:46 http://deb.debian.org/debian buster/main amd64 libxfixes3 amd64 1:5.0.3-1 [21.9 kB] Get:47 http://deb.debian.org/debian buster/main amd64 libxdamage1 amd64 1:1.1.4-3+b3 [14.9 kB] Get:48 http://deb.debian.org/debian buster/main amd64 libxxf86vm1 amd64 1:1.1.4-1+b2 [20.8 kB] Get:49 http://deb.debian.org/debian buster/main amd64 libllvm7 amd64 1:7.0.1-8+deb10u2 [13.1 MB] Get:50 http://deb.debian.org/debian buster/main amd64 libsensors-config all 1:3.5.0-3 [31.6 kB] Get:51 http://deb.debian.org/debian buster/main amd64 libsensors5 amd64 1:3.5.0-3 [52.6 kB] Get:52 http://deb.debian.org/debian buster/main amd64 libgl1-mesa-dri amd64 18.3.6-2+deb10u1 [6685 kB] Get:53 http://deb.debian.org/debian buster/main amd64 libglx-mesa0 amd64 18.3.6-2+deb10u1 [180 kB] Get:54 http://deb.debian.org/debian buster/main amd64 libglx0 amd64 1.1.0-1 [30.0 kB] Get:55 http://deb.debian.org/debian buster/main amd64 libgl1 amd64 1.1.0-1 [91.1 kB] Get:56 http://deb.debian.org/debian buster/main amd64 libopengl0 amd64 1.1.0-1 [33.4 kB] Get:57 http://deb.debian.org/debian buster/main amd64 libglvnd-dev amd64 1.1.0-1 [5128 B] Get:58 http://deb.debian.org/debian-security buster/updates/main amd64 libx11-xcb-dev amd64 2:1.6.7-1+deb10u4 [193 kB] Get:59 http://deb.debian.org/debian buster/main amd64 libxcb-dri3-dev amd64 1.13.1-2 [101 kB] Get:60 http://deb.debian.org/debian buster/main amd64 libxcb-randr0 amd64 1.13.1-2 [110 kB] Get:61 http://deb.debian.org/debian buster/main amd64 libxcb-render0 amd64 1.13.1-2 [109 kB] Get:62 http://deb.debian.org/debian buster/main amd64 libxcb-render0-dev amd64 1.13.1-2 [112 kB] Get:63 http://deb.debian.org/debian buster/main amd64 libxcb-randr0-dev amd64 1.13.1-2 [114 kB] Get:64 http://deb.debian.org/debian buster/main amd64 libxcb-shape0 amd64 1.13.1-2 [99.5 kB] Get:65 http://deb.debian.org/debian buster/main amd64 libxcb-shape0-dev amd64 1.13.1-2 [101 kB] Get:66 http://deb.debian.org/debian buster/main amd64 libxcb-xfixes0-dev amd64 1.13.1-2 [105 kB] Get:67 http://deb.debian.org/debian buster/main amd64 libxcb-sync-dev amd64 1.13.1-2 [104 kB] Get:68 http://deb.debian.org/debian buster/main amd64 libxcb-present-dev amd64 1.13.1-2 [101 kB] Get:69 http://deb.debian.org/debian buster/main amd64 libxshmfence-dev amd64 1.3-1 [8360 B] Get:70 http://deb.debian.org/debian buster/main amd64 libxcb-dri2-0-dev amd64 1.13.1-2 [102 kB] Get:71 http://deb.debian.org/debian buster/main amd64 libxcb-glx0-dev amd64 1.13.1-2 [122 kB] Get:72 http://deb.debian.org/debian buster/main amd64 x11proto-fixes-dev all 1:2018.4-4 [3140 B] Get:73 http://deb.debian.org/debian buster/main amd64 libxfixes-dev amd64 1:5.0.3-1 [23.8 kB] Get:74 http://deb.debian.org/debian buster/main amd64 x11proto-damage-dev all 1:2018.4-4 [3140 B] Get:75 http://deb.debian.org/debian buster/main amd64 libxdamage-dev amd64 1:1.1.4-3+b3 [14.6 kB] Get:76 http://deb.debian.org/debian buster/main amd64 x11proto-xext-dev all 2018.4-4 [3128 B] Get:77 http://deb.debian.org/debian buster/main amd64 libxext-dev amd64 2:1.3.3-1+b2 [107 kB] Get:78 http://deb.debian.org/debian buster/main amd64 x11proto-xf86vidmode-dev all 2018.4-4 [3140 B] Get:79 http://deb.debian.org/debian buster/main amd64 libxxf86vm-dev amd64 1:1.1.4-1+b2 [25.4 kB] Get:80 http://deb.debian.org/debian buster/main amd64 libgl1-mesa-dev amd64 18.3.6-2+deb10u1 [48.0 kB] Get:81 http://deb.debian.org/debian buster/main amd64 libidn11 amd64 1.33-2.2 [116 kB] Get:82 http://deb.debian.org/debian buster/main amd64 libmagic-mgc amd64 1:5.35-4+deb10u2 [242 kB] Get:83 http://deb.debian.org/debian buster/main amd64 libmagic1 amd64 1:5.35-4+deb10u2 [118 kB] Get:84 http://deb.debian.org/debian buster/main amd64 libmagic-dev amd64 1:5.35-4+deb10u2 [130 kB] Get:85 http://deb.debian.org/debian-security buster/updates/main amd64 inetutils-ping amd64 2:1.9.4-7+deb10u3 [227 kB] debconf: delaying package configuration, since apt-utils is not installed Fetched 28.1 MB in 6s (4726 kB/s) Selecting previously unselected package libbsd0:amd64. (Reading database ...(Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75%(Reading database ... 80%(Reading database ... 85%(Reading database ... 90%(Reading database ... 95%(Reading database ... 100% (Reading database ... 6843 files and directories currently installed.) Preparing to unpack .../00-libbsd0_0.9.1-2+deb10u1_amd64.deb ... Unpacking libbsd0:amd64 (0.9.1-2+deb10u1) ... Selecting previously unselected package libdrm-common. Preparing to unpack .../01-libdrm-common_2.4.97-1_all.deb ... Unpacking libdrm-common (2.4.97-1) ... Selecting previously unselected package libdrm2:amd64. Preparing to unpack .../02-libdrm2_2.4.97-1_amd64.deb ... Unpacking libdrm2:amd64 (2.4.97-1) ... Selecting previously unselected package libdrm-amdgpu1:amd64. Preparing to unpack .../03-libdrm-amdgpu1_2.4.97-1_amd64.deb ... Unpacking libdrm-amdgpu1:amd64 (2.4.97-1) ... Selecting previously unselected package libpciaccess0:amd64. Preparing to unpack .../04-libpciaccess0_0.14-1_amd64.deb ... Unpacking libpciaccess0:amd64 (0.14-1) ... Selecting previously unselected package libdrm-intel1:amd64. Preparing to unpack .../05-libdrm-intel1_2.4.97-1_amd64.deb ... Unpacking libdrm-intel1:amd64 (2.4.97-1) ... Selecting previously unselected package libdrm-radeon1:amd64. Preparing to unpack .../06-libdrm-radeon1_2.4.97-1_amd64.deb ... Unpacking libdrm-radeon1:amd64 (2.4.97-1) ... Selecting previously unselected package libdrm-nouveau2:amd64. Preparing to unpack .../07-libdrm-nouveau2_2.4.97-1_amd64.deb ... Unpacking libdrm-nouveau2:amd64 (2.4.97-1) ... Selecting previously unselected package libdrm-dev:amd64. Preparing to unpack .../08-libdrm-dev_2.4.97-1_amd64.deb ... Unpacking libdrm-dev:amd64 (2.4.97-1) ... Selecting previously unselected package libedit2:amd64. Preparing to unpack .../09-libedit2_3.1-20181209-1_amd64.deb ... Unpacking libedit2:amd64 (3.1-20181209-1) ... Selecting previously unselected package libwayland-server0:amd64. Preparing to unpack .../10-libwayland-server0_1.16.0-1_amd64.deb ... Unpacking libwayland-server0:amd64 (1.16.0-1) ... Selecting previously unselected package libgbm1:amd64. Preparing to unpack .../11-libgbm1_18.3.6-2+deb10u1_amd64.deb ... Unpacking libgbm1:amd64 (18.3.6-2+deb10u1) ... Selecting previously unselected package libglapi-mesa:amd64. Preparing to unpack .../12-libglapi-mesa_18.3.6-2+deb10u1_amd64.deb ... Unpacking libglapi-mesa:amd64 (18.3.6-2+deb10u1) ... Selecting previously unselected package libwayland-client0:amd64. Preparing to unpack .../13-libwayland-client0_1.16.0-1_amd64.deb ... Unpacking libwayland-client0:amd64 (1.16.0-1) ... Selecting previously unselected package libx11-xcb1:amd64. Preparing to unpack .../14-libx11-xcb1_2%3a1.6.7-1+deb10u4_amd64.deb ... Unpacking libx11-xcb1:amd64 (2:1.6.7-1+deb10u4) ... Selecting previously unselected package libxau6:amd64. Preparing to unpack .../15-libxau6_1%3a1.0.8-1+b2_amd64.deb ... Unpacking libxau6:amd64 (1:1.0.8-1+b2) ... Selecting previously unselected package libxdmcp6:amd64. Preparing to unpack .../16-libxdmcp6_1%3a1.1.2-3_amd64.deb ... Unpacking libxdmcp6:amd64 (1:1.1.2-3) ... Selecting previously unselected package libxcb1:amd64. Preparing to unpack .../17-libxcb1_1.13.1-2_amd64.deb ... Unpacking libxcb1:amd64 (1.13.1-2) ... Selecting previously unselected package libxcb-dri2-0:amd64. Preparing to unpack .../18-libxcb-dri2-0_1.13.1-2_amd64.deb ... Unpacking libxcb-dri2-0:amd64 (1.13.1-2) ... Selecting previously unselected package libxcb-dri3-0:amd64. Preparing to unpack .../19-libxcb-dri3-0_1.13.1-2_amd64.deb ... Unpacking libxcb-dri3-0:amd64 (1.13.1-2) ... Selecting previously unselected package libxcb-present0:amd64. Preparing to unpack .../20-libxcb-present0_1.13.1-2_amd64.deb ... Unpacking libxcb-present0:amd64 (1.13.1-2) ... Selecting previously unselected package libxcb-sync1:amd64. Preparing to unpack .../21-libxcb-sync1_1.13.1-2_amd64.deb ... Unpacking libxcb-sync1:amd64 (1.13.1-2) ... Selecting previously unselected package libxcb-xfixes0:amd64. Preparing to unpack .../22-libxcb-xfixes0_1.13.1-2_amd64.deb ... Unpacking libxcb-xfixes0:amd64 (1.13.1-2) ... Selecting previously unselected package libxshmfence1:amd64. Preparing to unpack .../23-libxshmfence1_1.3-1_amd64.deb ... Unpacking libxshmfence1:amd64 (1.3-1) ... Selecting previously unselected package libegl-mesa0:amd64. Preparing to unpack .../24-libegl-mesa0_18.3.6-2+deb10u1_amd64.deb ... Unpacking libegl-mesa0:amd64 (18.3.6-2+deb10u1) ... Selecting previously unselected package libelf1:amd64. Preparing to unpack .../25-libelf1_0.176-1.1+deb10u1_amd64.deb ... Unpacking libelf1:amd64 (0.176-1.1+deb10u1) ... Selecting previously unselected package libx11-data. Preparing to unpack .../26-libx11-data_2%3a1.6.7-1+deb10u4_all.deb ... Unpacking libx11-data (2:1.6.7-1+deb10u4) ... Selecting previously unselected package libx11-6:amd64. Preparing to unpack .../27-libx11-6_2%3a1.6.7-1+deb10u4_amd64.deb ... Unpacking libx11-6:amd64 (2:1.6.7-1+deb10u4) ... Selecting previously unselected package xorg-sgml-doctools. Preparing to unpack .../28-xorg-sgml-doctools_1%3a1.11-1_all.deb ... Unpacking xorg-sgml-doctools (1:1.11-1) ... Selecting previously unselected package x11proto-dev. Preparing to unpack .../29-x11proto-dev_2018.4-4_all.deb ... Unpacking x11proto-dev (2018.4-4) ... Selecting previously unselected package x11proto-core-dev. Preparing to unpack .../30-x11proto-core-dev_2018.4-4_all.deb ... Unpacking x11proto-core-dev (2018.4-4) ... Selecting previously unselected package libxau-dev:amd64. Preparing to unpack .../31-libxau-dev_1%3a1.0.8-1+b2_amd64.deb ... Unpacking libxau-dev:amd64 (1:1.0.8-1+b2) ... Selecting previously unselected package libxdmcp-dev:amd64. Preparing to unpack .../32-libxdmcp-dev_1%3a1.1.2-3_amd64.deb ... Unpacking libxdmcp-dev:amd64 (1:1.1.2-3) ... Selecting previously unselected package xtrans-dev. Preparing to unpack .../33-xtrans-dev_1.3.5-1_all.deb ... Unpacking xtrans-dev (1.3.5-1) ... Selecting previously unselected package libpthread-stubs0-dev:amd64. Preparing to unpack .../34-libpthread-stubs0-dev_0.4-1_amd64.deb ... Unpacking libpthread-stubs0-dev:amd64 (0.4-1) ... Selecting previously unselected package libxcb1-dev:amd64. Preparing to unpack .../35-libxcb1-dev_1.13.1-2_amd64.deb ... Unpacking libxcb1-dev:amd64 (1.13.1-2) ... Selecting previously unselected package libx11-dev:amd64. Preparing to unpack .../36-libx11-dev_2%3a1.6.7-1+deb10u4_amd64.deb ... Unpacking libx11-dev:amd64 (2:1.6.7-1+deb10u4) ... Selecting previously unselected package mesa-common-dev:amd64. Preparing to unpack .../37-mesa-common-dev_18.3.6-2+deb10u1_amd64.deb ... Unpacking mesa-common-dev:amd64 (18.3.6-2+deb10u1) ... Selecting previously unselected package libglvnd0:amd64. Preparing to unpack .../38-libglvnd0_1.1.0-1_amd64.deb ... Unpacking libglvnd0:amd64 (1.1.0-1) ... Selecting previously unselected package libglvnd-core-dev:amd64. Preparing to unpack .../39-libglvnd-core-dev_1.1.0-1_amd64.deb ... Unpacking libglvnd-core-dev:amd64 (1.1.0-1) ... Selecting previously unselected package libegl1:amd64. Preparing to unpack .../40-libegl1_1.1.0-1_amd64.deb ... Unpacking libegl1:amd64 (1.1.0-1) ... Selecting previously unselected package libgles1:amd64. Preparing to unpack .../41-libgles1_1.1.0-1_amd64.deb ... Unpacking libgles1:amd64 (1.1.0-1) ... Selecting previously unselected package libgles2:amd64. Preparing to unpack .../42-libgles2_1.1.0-1_amd64.deb ... Unpacking libgles2:amd64 (1.1.0-1) ... Selecting previously unselected package libxext6:amd64. Preparing to unpack .../43-libxext6_2%3a1.3.3-1+b2_amd64.deb ... Unpacking libxext6:amd64 (2:1.3.3-1+b2) ... Selecting previously unselected package libxcb-glx0:amd64. Preparing to unpack .../44-libxcb-glx0_1.13.1-2_amd64.deb ... Unpacking libxcb-glx0:amd64 (1.13.1-2) ... Selecting previously unselected package libxfixes3:amd64. Preparing to unpack .../45-libxfixes3_1%3a5.0.3-1_amd64.deb ... Unpacking libxfixes3:amd64 (1:5.0.3-1) ... Selecting previously unselected package libxdamage1:amd64. Preparing to unpack .../46-libxdamage1_1%3a1.1.4-3+b3_amd64.deb ... Unpacking libxdamage1:amd64 (1:1.1.4-3+b3) ... Selecting previously unselected package libxxf86vm1:amd64. Preparing to unpack .../47-libxxf86vm1_1%3a1.1.4-1+b2_amd64.deb ... Unpacking libxxf86vm1:amd64 (1:1.1.4-1+b2) ... Selecting previously unselected package libllvm7:amd64. Preparing to unpack .../48-libllvm7_1%3a7.0.1-8+deb10u2_amd64.deb ... Unpacking libllvm7:amd64 (1:7.0.1-8+deb10u2) ... Selecting previously unselected package libsensors-config. Preparing to unpack .../49-libsensors-config_1%3a3.5.0-3_all.deb ... Unpacking libsensors-config (1:3.5.0-3) ... Selecting previously unselected package libsensors5:amd64. Preparing to unpack .../50-libsensors5_1%3a3.5.0-3_amd64.deb ... Unpacking libsensors5:amd64 (1:3.5.0-3) ... Selecting previously unselected package libgl1-mesa-dri:amd64. Preparing to unpack .../51-libgl1-mesa-dri_18.3.6-2+deb10u1_amd64.deb ... Unpacking libgl1-mesa-dri:amd64 (18.3.6-2+deb10u1) ... Selecting previously unselected package libglx-mesa0:amd64. Preparing to unpack .../52-libglx-mesa0_18.3.6-2+deb10u1_amd64.deb ... Unpacking libglx-mesa0:amd64 (18.3.6-2+deb10u1) ... Selecting previously unselected package libglx0:amd64. Preparing to unpack .../53-libglx0_1.1.0-1_amd64.deb ... Unpacking libglx0:amd64 (1.1.0-1) ... Selecting previously unselected package libgl1:amd64. Preparing to unpack .../54-libgl1_1.1.0-1_amd64.deb ... Unpacking libgl1:amd64 (1.1.0-1) ... Selecting previously unselected package libopengl0:amd64. Preparing to unpack .../55-libopengl0_1.1.0-1_amd64.deb ... Unpacking libopengl0:amd64 (1.1.0-1) ... Selecting previously unselected package libglvnd-dev:amd64. Preparing to unpack .../56-libglvnd-dev_1.1.0-1_amd64.deb ... Unpacking libglvnd-dev:amd64 (1.1.0-1) ... Selecting previously unselected package libx11-xcb-dev:amd64. Preparing to unpack .../57-libx11-xcb-dev_2%3a1.6.7-1+deb10u4_amd64.deb ... Unpacking libx11-xcb-dev:amd64 (2:1.6.7-1+deb10u4) ... Selecting previously unselected package libxcb-dri3-dev:amd64. Preparing to unpack .../58-libxcb-dri3-dev_1.13.1-2_amd64.deb ... Unpacking libxcb-dri3-dev:amd64 (1.13.1-2) ... Selecting previously unselected package libxcb-randr0:amd64. Preparing to unpack .../59-libxcb-randr0_1.13.1-2_amd64.deb ... Unpacking libxcb-randr0:amd64 (1.13.1-2) ... Selecting previously unselected package libxcb-render0:amd64. Preparing to unpack .../60-libxcb-render0_1.13.1-2_amd64.deb ... Unpacking libxcb-render0:amd64 (1.13.1-2) ... Selecting previously unselected package libxcb-render0-dev:amd64. Preparing to unpack .../61-libxcb-render0-dev_1.13.1-2_amd64.deb ... Unpacking libxcb-render0-dev:amd64 (1.13.1-2) ... Selecting previously unselected package libxcb-randr0-dev:amd64. Preparing to unpack .../62-libxcb-randr0-dev_1.13.1-2_amd64.deb ... Unpacking libxcb-randr0-dev:amd64 (1.13.1-2) ... Selecting previously unselected package libxcb-shape0:amd64. Preparing to unpack .../63-libxcb-shape0_1.13.1-2_amd64.deb ... Unpacking libxcb-shape0:amd64 (1.13.1-2) ... Selecting previously unselected package libxcb-shape0-dev:amd64. Preparing to unpack .../64-libxcb-shape0-dev_1.13.1-2_amd64.deb ... Unpacking libxcb-shape0-dev:amd64 (1.13.1-2) ... Selecting previously unselected package libxcb-xfixes0-dev:amd64. Preparing to unpack .../65-libxcb-xfixes0-dev_1.13.1-2_amd64.deb ... Unpacking libxcb-xfixes0-dev:amd64 (1.13.1-2) ... Selecting previously unselected package libxcb-sync-dev:amd64. Preparing to unpack .../66-libxcb-sync-dev_1.13.1-2_amd64.deb ... Unpacking libxcb-sync-dev:amd64 (1.13.1-2) ... Selecting previously unselected package libxcb-present-dev:amd64. Preparing to unpack .../67-libxcb-present-dev_1.13.1-2_amd64.deb ... Unpacking libxcb-present-dev:amd64 (1.13.1-2) ... Selecting previously unselected package libxshmfence-dev:amd64. Preparing to unpack .../68-libxshmfence-dev_1.3-1_amd64.deb ... Unpacking libxshmfence-dev:amd64 (1.3-1) ... Selecting previously unselected package libxcb-dri2-0-dev:amd64. Preparing to unpack .../69-libxcb-dri2-0-dev_1.13.1-2_amd64.deb ... Unpacking libxcb-dri2-0-dev:amd64 (1.13.1-2) ... Selecting previously unselected package libxcb-glx0-dev:amd64. Preparing to unpack .../70-libxcb-glx0-dev_1.13.1-2_amd64.deb ... Unpacking libxcb-glx0-dev:amd64 (1.13.1-2) ... Selecting previously unselected package x11proto-fixes-dev. Preparing to unpack .../71-x11proto-fixes-dev_1%3a2018.4-4_all.deb ... Unpacking x11proto-fixes-dev (1:2018.4-4) ... Selecting previously unselected package libxfixes-dev:amd64. Preparing to unpack .../72-libxfixes-dev_1%3a5.0.3-1_amd64.deb ... Unpacking libxfixes-dev:amd64 (1:5.0.3-1) ... Selecting previously unselected package x11proto-damage-dev. Preparing to unpack .../73-x11proto-damage-dev_1%3a2018.4-4_all.deb ... Unpacking x11proto-damage-dev (1:2018.4-4) ... Selecting previously unselected package libxdamage-dev:amd64. Preparing to unpack .../74-libxdamage-dev_1%3a1.1.4-3+b3_amd64.deb ... Unpacking libxdamage-dev:amd64 (1:1.1.4-3+b3) ... Selecting previously unselected package x11proto-xext-dev. Preparing to unpack .../75-x11proto-xext-dev_2018.4-4_all.deb ... Unpacking x11proto-xext-dev (2018.4-4) ... Selecting previously unselected package libxext-dev:amd64. Preparing to unpack .../76-libxext-dev_2%3a1.3.3-1+b2_amd64.deb ... Unpacking libxext-dev:amd64 (2:1.3.3-1+b2) ... Selecting previously unselected package x11proto-xf86vidmode-dev. Preparing to unpack .../77-x11proto-xf86vidmode-dev_2018.4-4_all.deb ... Unpacking x11proto-xf86vidmode-dev (2018.4-4) ... Selecting previously unselected package libxxf86vm-dev:amd64. Preparing to unpack .../78-libxxf86vm-dev_1%3a1.1.4-1+b2_amd64.deb ... Unpacking libxxf86vm-dev:amd64 (1:1.1.4-1+b2) ... Selecting previously unselected package libgl1-mesa-dev:amd64. Preparing to unpack .../79-libgl1-mesa-dev_18.3.6-2+deb10u1_amd64.deb ... Unpacking libgl1-mesa-dev:amd64 (18.3.6-2+deb10u1) ... Selecting previously unselected package libidn11:amd64. Preparing to unpack .../80-libidn11_1.33-2.2_amd64.deb ... Unpacking libidn11:amd64 (1.33-2.2) ... Selecting previously unselected package libmagic-mgc. Preparing to unpack .../81-libmagic-mgc_1%3a5.35-4+deb10u2_amd64.deb ... Unpacking libmagic-mgc (1:5.35-4+deb10u2) ... Selecting previously unselected package libmagic1:amd64. Preparing to unpack .../82-libmagic1_1%3a5.35-4+deb10u2_amd64.deb ... Unpacking libmagic1:amd64 (1:5.35-4+deb10u2) ... Selecting previously unselected package libmagic-dev:amd64. Preparing to unpack .../83-libmagic-dev_1%3a5.35-4+deb10u2_amd64.deb ... Unpacking libmagic-dev:amd64 (1:5.35-4+deb10u2) ... Selecting previously unselected package inetutils-ping. Preparing to unpack .../84-inetutils-ping_2%3a1.9.4-7+deb10u3_amd64.deb ... Unpacking inetutils-ping (2:1.9.4-7+deb10u3) ... Setting up libwayland-server0:amd64 (1.16.0-1) ... Setting up libx11-xcb1:amd64 (2:1.6.7-1+deb10u4) ... Setting up libpciaccess0:amd64 (0.14-1) ... Setting up libxau6:amd64 (1:1.0.8-1+b2) ... Setting up libglvnd-core-dev:amd64 (1.1.0-1) ... Setting up libmagic-mgc (1:5.35-4+deb10u2) ... Setting up libglvnd0:amd64 (1.1.0-1) ... Setting up libsensors-config (1:3.5.0-3) ... Setting up libmagic1:amd64 (1:5.35-4+deb10u2) ... Setting up libmagic-dev:amd64 (1:5.35-4+deb10u2) ... Setting up libpthread-stubs0-dev:amd64 (0.4-1) ... Setting up libopengl0:amd64 (1.1.0-1) ... Setting up xtrans-dev (1.3.5-1) ... Setting up libgles2:amd64 (1.1.0-1) ... Setting up libx11-data (2:1.6.7-1+deb10u4) ... Setting up libidn11:amd64 (1.33-2.2) ... Setting up libgles1:amd64 (1.1.0-1) ... Setting up libsensors5:amd64 (1:3.5.0-3) ... Setting up libglapi-mesa:amd64 (18.3.6-2+deb10u1) ... Setting up inetutils-ping (2:1.9.4-7+deb10u3) ... Setting up libxshmfence1:amd64 (1.3-1) ... Setting up xorg-sgml-doctools (1:1.11-1) ... Setting up libbsd0:amd64 (0.9.1-2+deb10u1) ... Setting up libdrm-common (2.4.97-1) ... Setting up libelf1:amd64 (0.176-1.1+deb10u1) ... Setting up libwayland-client0:amd64 (1.16.0-1) ... Setting up x11proto-dev (2018.4-4) ... Setting up libxdmcp6:amd64 (1:1.1.2-3) ... Setting up libxcb1:amd64 (1.13.1-2) ... Setting up libxcb-xfixes0:amd64 (1.13.1-2) ... Setting up libxau-dev:amd64 (1:1.0.8-1+b2) ... Setting up libxcb-render0:amd64 (1.13.1-2) ... Setting up libxshmfence-dev:amd64 (1.3-1) ... Setting up libxcb-glx0:amd64 (1.13.1-2) ... Setting up libedit2:amd64 (3.1-20181209-1) ... Setting up libxcb-shape0:amd64 (1.13.1-2) ... Setting up libxcb-present0:amd64 (1.13.1-2) ... Setting up libxdmcp-dev:amd64 (1:1.1.2-3) ... Setting up x11proto-damage-dev (1:2018.4-4) ... Setting up libxcb-sync1:amd64 (1.13.1-2) ... Setting up x11proto-core-dev (2018.4-4) ... Setting up libxcb-dri2-0:amd64 (1.13.1-2) ... Setting up x11proto-xf86vidmode-dev (2018.4-4) ... Setting up x11proto-xext-dev (2018.4-4) ... Setting up libdrm2:amd64 (2.4.97-1) ... Setting up libxcb-randr0:amd64 (1.13.1-2) ... Setting up libllvm7:amd64 (1:7.0.1-8+deb10u2) ... Setting up libx11-6:amd64 (2:1.6.7-1+deb10u4) ... Setting up x11proto-fixes-dev (1:2018.4-4) ... Setting up libdrm-amdgpu1:amd64 (2.4.97-1) ... Setting up libxcb-dri3-0:amd64 (1.13.1-2) ... Setting up libdrm-nouveau2:amd64 (2.4.97-1) ... Setting up libxcb1-dev:amd64 (1.13.1-2) ... Setting up libgbm1:amd64 (18.3.6-2+deb10u1) ... Setting up libdrm-radeon1:amd64 (2.4.97-1) ... Setting up libdrm-intel1:amd64 (2.4.97-1) ... Setting up libgl1-mesa-dri:amd64 (18.3.6-2+deb10u1) ... Setting up libx11-dev:amd64 (2:1.6.7-1+deb10u4) ... Setting up libxext6:amd64 (2:1.3.3-1+b2) ... Setting up libxcb-dri3-dev:amd64 (1.13.1-2) ... Setting up libxxf86vm1:amd64 (1:1.1.4-1+b2) ... Setting up libegl-mesa0:amd64 (18.3.6-2+deb10u1) ... Setting up libxcb-dri2-0-dev:amd64 (1.13.1-2) ... Setting up libxfixes3:amd64 (1:5.0.3-1) ... Setting up libxcb-render0-dev:amd64 (1.13.1-2) ... Setting up libxcb-glx0-dev:amd64 (1.13.1-2) ... Setting up libxcb-shape0-dev:amd64 (1.13.1-2) ... Setting up libxext-dev:amd64 (2:1.3.3-1+b2) ... Setting up libegl1:amd64 (1.1.0-1) ... Setting up libxcb-sync-dev:amd64 (1.13.1-2) ... Setting up libxcb-xfixes0-dev:amd64 (1.13.1-2) ... Setting up libx11-xcb-dev:amd64 (2:1.6.7-1+deb10u4) ... Setting up libdrm-dev:amd64 (2.4.97-1) ... Setting up libxdamage1:amd64 (1:1.1.4-3+b3) ... Setting up libxxf86vm-dev:amd64 (1:1.1.4-1+b2) ... Setting up libxfixes-dev:amd64 (1:5.0.3-1) ... Setting up libxcb-randr0-dev:amd64 (1.13.1-2) ... Setting up libxcb-present-dev:amd64 (1.13.1-2) ... Setting up mesa-common-dev:amd64 (18.3.6-2+deb10u1) ... Setting up libxdamage-dev:amd64 (1:1.1.4-3+b3) ... Setting up libglx-mesa0:amd64 (18.3.6-2+deb10u1) ... Setting up libglx0:amd64 (1.1.0-1) ... Setting up libgl1:amd64 (1.1.0-1) ... Setting up libglvnd-dev:amd64 (1.1.0-1) ... Setting up libgl1-mesa-dev:amd64 (18.3.6-2+deb10u1) ... Processing triggers for libc-bin (2.28-10+deb10u2) ... [runtime 4/9] WORKDIR /app/ [builder 2/6] RUN pip install poetry Collecting poetry Downloading poetry-1.8.2-py3-none-any.whl (249 kB) âââââââââââââââââââââââââââââââââââââ 249.4/249.4 kB 303.7 kB/s eta 0:00:00 Collecting build<2.0.0,>=1.0.3 (from poetry) Downloading build-1.2.1-py3-none-any.whl (21 kB) Collecting cachecontrol[filecache]<0.15.0,>=0.14.0 (from poetry) Downloading cachecontrol-0.14.0-py3-none-any.whl (22 kB) Collecting cleo<3.0.0,>=2.1.0 (from poetry) Downloading cleo-2.1.0-py3-none-any.whl (78 kB) ââââââââââââââââââââââââââââââââââââââââ 78.7/78.7 kB 1.8 MB/s eta 0:00:00 Collecting crashtest<0.5.0,>=0.4.1 (from poetry) Downloading crashtest-0.4.1-py3-none-any.whl (7.6 kB) Collecting dulwich<0.22.0,>=0.21.2 (from poetry) Downloading dulwich-0.21.7-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (516 kB) âââââââââââââââââââââââââââââââââââââââ 516.4/516.4 kB 1.5 MB/s eta 0:00:00 Collecting fastjsonschema<3.0.0,>=2.18.0 (from poetry) Downloading fastjsonschema-2.19.1-py3-none-any.whl (23 kB) Collecting installer<0.8.0,>=0.7.0 (from poetry) Downloading installer-0.7.0-py3-none-any.whl (453 kB) âââââââââââââââââââââââââââââââââââââââ 453.8/453.8 kB 2.3 MB/s eta 0:00:00 Collecting keyring<25.0.0,>=24.0.0 (from poetry) Downloading keyring-24.3.1-py3-none-any.whl (38 kB) Collecting packaging>=23.1 (from poetry) Downloading packaging-24.0-py3-none-any.whl (53 kB) ââââââââââââââââââââââââââââââââââââââââ 53.5/53.5 kB 2.3 MB/s eta 0:00:00 Collecting pexpect<5.0.0,>=4.7.0 (from poetry) Downloading pexpect-4.9.0-py2.py3-none-any.whl (63 kB) ââââââââââââââââââââââââââââââââââââââââ 63.8/63.8 kB 2.2 MB/s eta 0:00:00 Collecting pkginfo<2.0.0,>=1.9.4 (from poetry) Downloading pkginfo-1.10.0-py3-none-any.whl (30 kB) Collecting platformdirs<5,>=3.0.0 (from poetry) Downloading platformdirs-4.2.0-py3-none-any.whl (17 kB) Collecting poetry-core==1.9.0 (from poetry) Downloading poetry_core-1.9.0-py3-none-any.whl (309 kB) âââââââââââââââââââââââââââââââââââââââ 309.5/309.5 kB 2.5 MB/s eta 0:00:00 Collecting poetry-plugin-export<2.0.0,>=1.6.0 (from poetry) Downloading poetry_plugin_export-1.7.1-py3-none-any.whl (10 kB) Collecting pyproject-hooks<2.0.0,>=1.0.0 (from poetry) Downloading pyproject_hooks-1.0.0-py3-none-any.whl (9.3 kB) Collecting requests<3.0,>=2.26 (from poetry) Downloading requests-2.31.0-py3-none-any.whl (62 kB) ââââââââââââââââââââââââââââââââââââââââ 62.6/62.6 kB 2.7 MB/s eta 0:00:00 Collecting requests-toolbelt<2.0.0,>=1.0.0 (from poetry) Downloading requests_toolbelt-1.0.0-py2.py3-none-any.whl (54 kB) ââââââââââââââââââââââââââââââââââââââââ 54.5/54.5 kB 1.2 MB/s eta 0:00:00 Collecting shellingham<2.0,>=1.5 (from poetry) Downloading shellingham-1.5.4-py2.py3-none-any.whl (9.8 kB) Collecting tomlkit<1.0.0,>=0.11.4 (from poetry) Downloading tomlkit-0.12.4-py3-none-any.whl (37 kB) Collecting trove-classifiers>=2022.5.19 (from poetry) Downloading trove_classifiers-2024.3.25-py3-none-any.whl (13 kB) Collecting virtualenv<21.0.0,>=20.23.0 (from poetry) Downloading virtualenv-20.25.1-py3-none-any.whl (3.8 MB) ââââââââââââââââââââââââââââââââââââââââ 3.8/3.8 MB 1.9 MB/s eta 0:00:00 Collecting msgpack<2.0.0,>=0.5.2 (from cachecontrol[filecache]<0.15.0,>=0.14.0->poetry) Downloading msgpack-1.0.8-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (409 kB) âââââââââââââââââââââââââââââââââââââââ 409.3/409.3 kB 1.7 MB/s eta 0:00:00 Collecting filelock>=3.8.0 (from cachecontrol[filecache]<0.15.0,>=0.14.0->poetry) Downloading filelock-3.13.3-py3-none-any.whl (11 kB) Collecting rapidfuzz<4.0.0,>=3.0.0 (from cleo<3.0.0,>=2.1.0->poetry) Downloading rapidfuzz-3.7.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.4 MB) ââââââââââââââââââââââââââââââââââââââââ 3.4/3.4 MB 2.2 MB/s eta 0:00:00 Collecting urllib3>=1.25 (from dulwich<0.22.0,>=0.21.2->poetry) Downloading urllib3-2.2.1-py3-none-any.whl (121 kB) âââââââââââââââââââââââââââââââââââââââ 121.1/121.1 kB 2.1 MB/s eta 0:00:00 Collecting jaraco.classes (from keyring<25.0.0,>=24.0.0->poetry) Downloading jaraco.classes-3.4.0-py3-none-any.whl (6.8 kB) Collecting importlib-metadata>=4.11.4 (from keyring<25.0.0,>=24.0.0->poetry) Downloading importlib_metadata-7.1.0-py3-none-any.whl (24 kB) Collecting SecretStorage>=3.2 (from keyring<25.0.0,>=24.0.0->poetry) Downloading SecretStorage-3.3.3-py3-none-any.whl (15 kB) Collecting jeepney>=0.4.2 (from keyring<25.0.0,>=24.0.0->poetry) Downloading jeepney-0.8.0-py3-none-any.whl (48 kB) ââââââââââââââââââââââââââââââââââââââââ 48.4/48.4 kB 2.4 MB/s eta 0:00:00 Collecting ptyprocess>=0.5 (from pexpect<5.0.0,>=4.7.0->poetry) Downloading ptyprocess-0.7.0-py2.py3-none-any.whl (13 kB) Collecting charset-normalizer<4,>=2 (from requests<3.0,>=2.26->poetry) Downloading charset_normalizer-3.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (140 kB) âââââââââââââââââââââââââââââââââââââââ 140.3/140.3 kB 1.7 MB/s eta 0:00:00 Collecting idna<4,>=2.5 (from requests<3.0,>=2.26->poetry) Downloading idna-3.6-py3-none-any.whl (61 kB) ââââââââââââââââââââââââââââââââââââââââ 61.6/61.6 kB 1.8 MB/s eta 0:00:00 Collecting certifi>=2017.4.17 (from requests<3.0,>=2.26->poetry) Downloading certifi-2024.2.2-py3-none-any.whl (163 kB) âââââââââââââââââââââââââââââââââââââââ 163.8/163.8 kB 1.9 MB/s eta 0:00:00 Collecting distlib<1,>=0.3.7 (from virtualenv<21.0.0,>=20.23.0->poetry) Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) âââââââââââââââââââââââââââââââââââââââ 468.9/468.9 kB 1.8 MB/s eta 0:00:00 Collecting zipp>=0.5 (from importlib-metadata>=4.11.4->keyring<25.0.0,>=24.0.0->poetry) Downloading zipp-3.18.1-py3-none-any.whl (8.2 kB) Collecting cryptography>=2.0 (from SecretStorage>=3.2->keyring<25.0.0,>=24.0.0->poetry) Downloading cryptography-42.0.5-cp39-abi3-manylinux_2_28_x86_64.whl (4.6 MB) ââââââââââââââââââââââââââââââââââââââââ 4.6/4.6 MB 1.7 MB/s eta 0:00:00 Collecting more-itertools (from jaraco.classes->keyring<25.0.0,>=24.0.0->poetry) Downloading more_itertools-10.2.0-py3-none-any.whl (57 kB) ââââââââââââââââââââââââââââââââââââââââ 57.0/57.0 kB 1.9 MB/s eta 0:00:00 Collecting cffi>=1.12 (from cryptography>=2.0->SecretStorage>=3.2->keyring<25.0.0,>=24.0.0->poetry) Downloading cffi-1.16.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (464 kB) âââââââââââââââââââââââââââââââââââââââ 464.8/464.8 kB 1.4 MB/s eta 0:00:00 Collecting pycparser (from cffi>=1.12->cryptography>=2.0->SecretStorage>=3.2->keyring<25.0.0,>=24.0.0->poetry) Downloading pycparser-2.22-py3-none-any.whl (117 kB) âââââââââââââââââââââââââââââââââââââââ 117.6/117.6 kB 1.4 MB/s eta 0:00:00 Installing collected packages: trove-classifiers, ptyprocess, fastjsonschema, distlib, zipp, urllib3, tomlkit, shellingham, rapidfuzz, pyproject-hooks, pycparser, poetry-core, platformdirs, pkginfo, pexpect, packaging, msgpack, more-itertools, jeepney, installer, idna, filelock, crashtest, charset-normalizer, certifi, virtualenv, requests, jaraco.classes, importlib-metadata, dulwich, cleo, cffi, build, requests-toolbelt, cryptography, cachecontrol, SecretStorage, keyring, poetry-plugin-export, poetry Successfully installed SecretStorage-3.3.3 build-1.2.1 cachecontrol-0.14.0 certifi-2024.2.2 cffi-1.16.0 charset-normalizer-3.3.2 cleo-2.1.0 crashtest-0.4.1 cryptography-42.0.5 distlib-0.3.8 dulwich-0.21.7 fastjsonschema-2.19.1 filelock-3.13.3 idna-3.6 importlib-metadata-7.1.0 installer-0.7.0 jaraco.classes-3.4.0 jeepney-0.8.0 keyring-24.3.1 more-itertools-10.2.0 msgpack-1.0.8 packaging-24.0 pexpect-4.9.0 pkginfo-1.10.0 platformdirs-4.2.0 poetry-1.8.2 poetry-core-1.9.0 poetry-plugin-export-1.7.1 ptyprocess-0.7.0 pycparser-2.22 pyproject-hooks-1.0.0 rapidfuzz-3.7.0 requests-2.31.0 requests-toolbelt-1.0.0 shellingham-1.5.4 tomlkit-0.12.4 trove-classifiers-2024.3.25 urllib3-2.2.1 virtualenv-20.25.1 zipp-3.18.1 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv [notice] A new release of pip is available: 23.1.2 -> 24.0 [notice] To update, run: pip install --upgrade pip [builder 3/6] WORKDIR /app/ [builder 4/5] ADD pyproject.toml poetry.lock ./ [builder 5/5] RUN --mount=type=cache,target=/tmp/poetry_cache poetry install --no-root --no-ansi --with streamlit-app,ai,ingester --without dev,worker,api --no-root Creating virtualenv redbox in /app/.venv Installing dependencies from lock file Package operations:218 installs,1 update, 0 removals - Installing nvidia-nvjitlink-cu12 (12.4.99) - Installing filelock (3.13.1) - Installing markupsafe (2.1.5) - Installing mpmath (1.3.0) - Installing nvidia-cublas-cu12 (12.1.3.1) - Installing nvidia-cusparse-cu12 (12.1.0.106) Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file - Installing certifi (2024.2.2) - Installing charset-normalizer (3.3.2) - Installing idna (3.6) - Installing jinja2 (3.1.3) - Installing fsspec (2024.2.0) - Installing networkx (3.2.1) - Installing numpy (1.26.4) - Installing nvidia-cuda-runtime-cu12 (12.1.105) - Installing nvidia-cuda-nvrtc-cu12 (12.1.105) - Installing nvidia-cuda-cupti-cu12 (12.1.105) - Installing nvidia-cudnn-cu12 (8.9.2.26) - Installing nvidia-curand-cu12 (10.3.2.106) - Installing nvidia-cusolver-cu12 (11.4.5.107) - Installing nvidia-nvtx-cu12 (12.1.105) - Installing nvidia-nccl-cu12 (2.19.3) - Installing nvidia-cufft-cu12 (11.0.2.54) - Installing six (1.16.0) - Installing pycparser (2.21) - Installing sympy (1.12) - Installing triton (2.2.0) - Installing typing-extensions (4.9.0) - Installing urllib3 (1.26.18) Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/nvidia/__init__.py over existing file - Installing attrs (23.2.0) - Installing cffi (1.16.0) - Installing contourpy (1.2.0) - Installing fonttools (4.49.0) - Installing kiwisolver (1.4.5) - Installing cycler (0.12.1) - Installing pillow (10.2.0) - Installing mdurl (0.1.2) - Installing python-dateutil (2.8.2) - Installing requests (2.31.0) - Installing torch (2.2.0) - Installing tqdm (4.66.2) - Installing pyyaml (6.0.1) - Installing pyparsing (3.0.9) - Installing rpds-py (0.18.0) - Installing packaging (23.2) - Installing annotated-types (0.6.0) - Installing antlr4-python3-runtime (4.9.3) - Installing click (8.1.7) - Installing cryptography (42.0.2) - Installing huggingface-hub (0.20.3) - Installing ghp-import (2.1.0) - Installing markdown (3.5.2) - Installing matplotlib (3.7.2) - Installing pathspec (0.12.1) - Installing pydantic-core (2.16.3) - Installing pygments (2.17.2) - Installing referencing (0.34.0) - Installing platformdirs (4.2.0) - Installing safetensors (0.3.2) - Installing pyyaml-env-tag (0.1) - Installing watchdog (4.0.0) - Installing torchvision (0.17.0) - Installing markdown-it-py (3.0.0) - Installing mergedeep (1.3.4) - Installing frozenlist (1.4.1) - Installing h11 (0.14.0) - Installing humanfriendly (10.0) - Installing jsonpointer (2.4) - Installing jsonschema-specifications (2023.12.1) - Installing mkdocs (1.5.3) - Installing mypy-extensions (1.0.0) - Installing orjson (3.10.0) - Installing omegaconf (2.3.0) - Installing portalocker (2.8.2) - Installing pycocotools (2.0.7) - Installing multidict (6.0.5) - Installing pypdfium2 (4.27.0) - Installing pytz (2024.1) - Installing shellingham (1.5.4) - Installing sniffio (1.3.1) - Installing pdfminer-six (20221105) - Installing smmap (5.0.1) - Installing rich (13.7.1) - Installing pydantic (2.6.4) - Installing timm (0.9.12) - Installing tzdata (2024.1) - Installing aiosignal (1.3.1) - Installing anyio (4.3.0) - Installing colorama (0.4.6) - Installing effdet (0.4.1) - Installing coloredlogs (15.0.1) - Installing flatbuffers (23.5.26) - Installing gitdb (4.0.11) - Installing httpcore (1.0.5) - Installing iopath (0.1.10) - Installing jsonpatch (1.33) - Installing jsonschema (4.21.1) - Installing langsmith (0.1.39) - Installing marshmallow (3.20.2) - Installing opencv-python (4.8.0.76) - Installing pandas (2.2.0) - Installing greenlet (3.0.3) - Installing mkdocs-autorefs (1.0.1) - Installing pdf2image (1.17.0) - Installing jmespath (1.0.1) - Installing pdfplumber (0.10.4) - Installing protobuf (4.23.4) - Installing pymdown-extensions (10.7.1) - Installing pytesseract (0.3.10) - Installing regex (2023.12.25) - Installing scipy (1.10.1) - Installing tenacity (8.2.3) - Installing tokenizers (0.15.2) - Installing toolz (0.12.1) - Installing typer-slim (0.12.0) - Installing typing-inspect (0.9.0) - Installing wrapt (1.16.0) - Installing yarl (1.9.4) - Installing aiohttp (3.9.3) - Installing altair (5.3.0) - Installing babel (2.14.0) - Installing botocore (1.34.77) - Installing dataclasses-json-speakeasy (0.5.11) - Installing cachetools (5.3.3) - Installing deprecated (1.2.14) - Installing distro (1.9.0) - Installing et-xmlfile (1.1.0) - Installing gitpython (3.1.43) - Installing griffe (0.42.1) - Installing editorconfig (0.12.4) - Installing blinker (1.7.0) - Installing dataclasses-json (0.6.4) - Installing langchain-core (0.1.39) - Installing layoutparser (0.3.4) - Installing jsonpath-python (1.0.6) - Installing joblib (1.3.2) - Installing httpx (0.27.0) - Installing log-symbols (0.0.14) Installing /app/.venv/lib/python3.11/site-packages/dataclasses_json/__init__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/dataclasses_json/__version__.py over existing file Installing /app/.venv/lib/python3.11/site-packages/dataclasses_json/cfg.py over existing file Installing /app/.venv/lib/python3.11/site-packages/dataclasses_json/core.py over existing file Installing /app/.venv/lib/python3.11/site-packages/dataclasses_json/mm.py over existing file - Installing lxml (5.1.0) Installing /app/.venv/lib/python3.11/site-packages/dataclasses_json/py.typed over existing file - Installing mkdocs-material-extensions (1.3.1) Installing /app/.venv/lib/python3.11/site-packages/dataclasses_json/stringcase.py over existing file - Installing mkdocstrings (0.24.2) Installing /app/.venv/lib/python3.11/site-packages/dataclasses_json/undefined.py over existing file Installing /app/.venv/lib/python3.11/site-packages/dataclasses_json/utils.py over existing file - Installing olefile (0.47) - Installing onnx (1.15.0) - Installing onnxruntime (1.15.1) - Installing paginate (0.5.6) - Installing pyarrow (15.0.2) - Installing pydeck (0.8.0) - Installing python-multipart (0.0.9) - Installing rapidfuzz (3.6.1) - Installing soupsieve (2.5) - Installing spinners (0.0.24) - Installing sqlalchemy (2.0.29) - Installing termcolor (2.4.0) - Installing threadpoolctl (3.4.0) - Installing toml (0.10.2) - Installing tornado (6.4) - Installing transformers (4.37.1) - Installing typer-cli (0.12.0) - Installing xlsxwriter (3.1.9) - Installing zipp (3.17.0) - Installing backoff (2.2.1) - Installing beautifulsoup4 (4.12.3) - Installing bump2version (1.0.1) - Installing chardet (5.2.0) - Installing elastic-transport (8.13.0) - Installing fast-depends (2.4.2) - Installing halo (0.0.31) - Installing importlib-metadata (7.0.1) - Installing filetype (1.2.0) - Installing emoji (2.10.1) - Installing langchain-text-splitters (0.0.1) - Installing langdetect (1.0.9) - Installing jsbeautifier (1.15.1) - Installing msg-parser (1.2.0) - Installing nltk (3.8.1) - Installing importlib-resources (6.1.1) - Installing mkdocstrings-python (1.9.2) - Installing openai (1.16.1) - Installing langchain-community (0.0.31) - Installing mkdocs-material (9.5.17) - Installing openpyxl (3.1.2) - Installing pikepdf (8.11.0) - Installing pillow-heif (0.15.0) - Installing pypandoc (1.12) - Installing pypdf (4.0.1) - Installing python-docx (1.1.0) - Installing python-dotenv (1.0.1) - Installing python-iso639 (2024.2.7) - Installing python-magic (0.4.27) - Installing python-pptx (0.6.23) - Installing redis (5.0.3) - Installing s3transfer (0.10.1) - Installing scikit-learn (1.4.1.post1) - Updating setuptools (69.1.0 -> 69.2.0) - Installing streamlit (1.32.2) - Installing tabulate (0.9.0) - Installing tiktoken (0.6.0) - Installing typer (0.12.0) - Installing unstructured-client (0.18.0) - Installing unstructured-inference (0.7.25) - Installing unstructured-pytesseract (0.3.12) - Installing xlrd (2.0.1) Installing /app/.venv/bin/pytesseract over existing file - Installing anthropic (0.21.3) - Installing boto3 (1.34.77) - Installing elasticsearch (8.13.0) - Installing loguru (0.7.2) - Installing langchain (0.1.14) - Installing litellm (1.34.22) - Installing markdown-mdantic (2.1.0) - Installing mkapi (2.1.0) - Installing opencv-python-headless (4.9.0.80) - Installing pika (1.3.2) - Installing html2markdown (0.1.7) - Installing sentence-transformers (2.6.1) - Installing streamlit-feedback (0.1.3) - Installing unstructured (0.13.0) - Installing bumpversion (0.6.0) - Installing faststream (0.4.7) - Installing mkdocs-mermaid2-plugin (1.1.1) - Installing pydantic-settings (2.2.1) OSError [Errno 28] No space left on device at /usr/local/lib/python3.11/tempfile.py:483 in func_wrapper 479â if hasattr(a, '__call__'): 480â func = a 481â @_functools.wraps(func) 482â def func_wrapper(*args, **kwargs): â 483â return func(*args, **kwargs) 484â # Avoid closing the file as long as the wrapper is alive, 485â # see issue #18879. 486â func_wrapper._closer = self._closer 487â a = func_wrapper The following error occurred when trying to handle this error: ProtocolError ("Connection broken: OSError(28, 'No space left on device')", OSError(28, 'No space left on device')) at /usr/local/lib/python3.11/site-packages/urllib3/response.py:764 in _error_catcher 760â arg = f"Connection broken: {e!r}" 761â raise ProtocolError(arg, e) from e 762â 763â except (HTTPException, OSError) as e: â 764â raise ProtocolError(f"Connection broken: {e!r}", e) from e 765â 766â # If no exception is thrown, we should avoid cleaning up 767â # unnecessarily. 768â clean_exit = True The following error occurred when trying to handle this error: ChunkedEncodingError ("Connection broken: OSError(28, 'No space left on device')", OSError(28, 'No space left on device')) at /usr/local/lib/python3.11/site-packages/requests/models.py:818 in generate 814â if hasattr(self.raw, "stream"): 815â try: 816â yield from self.raw.stream(chunk_size, decode_content=True) 817â except ProtocolError as e: â 818â raise ChunkedEncodingError(e) 819â except DecodeError as e: 820â raise ContentDecodingError(e) 821â except ReadTimeoutError as e: 822â raise ConnectionError(e) The following error occurred when trying to handle this error: OSError [Errno 28] No space left on device at /usr/local/lib/python3.11/site-packages/requests/utils.py:305 in atomic_open 301â def atomic_open(filename): 302â """Write a file to the disk in an atomic fashion""" 303â tmp_descriptor, tmp_name = tempfile.mkstemp(dir=os.path.dirname(filename)) 304â try: â 305â with os.fdopen(tmp_descriptor, "wb") as tmp_handler: 306â yield tmp_handler 307â os.replace(tmp_name, filename) 308â except BaseException: 309â os.remove(tmp_name) Cannot install opencv-python-headless. ```

redbox

```markdown [internal] load build definition from Dockerfile transferring 325/0 0.007 [internal] load metadata for docker.io/library/python:3.11 [internal] load .dockerignore [1/9] FROM docker.io/library/python:3.11@sha256:58ef3c375e20ca749f5bf4d1a62186a01e9d1d5756671037e391c832a5062d1e resolve docker.io/library/python:3.11@sha256:58ef3c375e20ca749f5bf4d1a62186a01e9d1d5756671037e391c832a5062d1e 0/0 0.031 done 2139/2139 -0.341 done 2007/2007 -0.216 done 7336/7336 -0.068 done 24046734/24046734 11.856 done 49552196/49552196 25.437 done 6390503/6390503 29.734 done 19844462/19844462 40.644 done 246/246 41.033 done 3130352/3130352 43.745 done 64140360/64140360 52.319 done 211139445/211139445 96.11 extract 0/0 3.827 extract 0/0 1.126 extract 0/0 4.304 extract 0/0 10.28 extract 0/0 0.502 extract 0/0 0.977 extract 0/0 0 extract 0/0 0.414 [internal] load build context transferring 824523/0 0.04 [2/9] RUN apt-get update Get:1 http://deb.debian.org/debian bookworm InRelease [151 kB] Get:2 http://deb.debian.org/debian bookworm-updates InRelease [55.4 kB] Get:3 http://deb.debian.org/debian-security bookworm-security InRelease [48.0 kB] Get:4 http://deb.debian.org/debian bookworm/main amd64 Packages [8786 kB] Get:5 http://deb.debian.org/debian bookworm-updates/main amd64 Packages [12.7 kB] Get:6 http://deb.debian.org/debian-security bookworm-security/main amd64 Packages [150 kB] Fetched 9203 kB in 4s (2302 kB/s) Reading package lists... [3/9] RUN pip install poetry Collecting poetry Downloading poetry-1.8.2-py3-none-any.whl.metadata (6.8 kB) Collecting build<2.0.0,>=1.0.3 (from poetry) Downloading build-1.2.1-py3-none-any.whl.metadata (4.3 kB) Collecting cachecontrol<0.15.0,>=0.14.0 (from cachecontrol[filecache]<0.15.0,>=0.14.0->poetry) Downloading cachecontrol-0.14.0-py3-none-any.whl.metadata (3.1 kB) Collecting cleo<3.0.0,>=2.1.0 (from poetry) Downloading cleo-2.1.0-py3-none-any.whl.metadata (12 kB) Collecting crashtest<0.5.0,>=0.4.1 (from poetry) Downloading crashtest-0.4.1-py3-none-any.whl.metadata (1.1 kB) Collecting dulwich<0.22.0,>=0.21.2 (from poetry) Downloading dulwich-0.21.7-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.3 kB) Collecting fastjsonschema<3.0.0,>=2.18.0 (from poetry) Downloading fastjsonschema-2.19.1-py3-none-any.whl.metadata (2.1 kB) Collecting installer<0.8.0,>=0.7.0 (from poetry) Downloading installer-0.7.0-py3-none-any.whl.metadata (936 bytes) Collecting keyring<25.0.0,>=24.0.0 (from poetry) Downloading keyring-24.3.1-py3-none-any.whl.metadata (20 kB) Collecting packaging>=23.1 (from poetry) Downloading packaging-24.0-py3-none-any.whl.metadata (3.2 kB) Collecting pexpect<5.0.0,>=4.7.0 (from poetry) Downloading pexpect-4.9.0-py2.py3-none-any.whl.metadata (2.5 kB) Collecting pkginfo<2.0.0,>=1.9.4 (from poetry) Downloading pkginfo-1.10.0-py3-none-any.whl.metadata (11 kB) Collecting platformdirs<5,>=3.0.0 (from poetry) Downloading platformdirs-4.2.0-py3-none-any.whl.metadata (11 kB) Collecting poetry-core==1.9.0 (from poetry) Downloading poetry_core-1.9.0-py3-none-any.whl.metadata (3.5 kB) Collecting poetry-plugin-export<2.0.0,>=1.6.0 (from poetry) Downloading poetry_plugin_export-1.7.1-py3-none-any.whl.metadata (2.8 kB) Collecting pyproject-hooks<2.0.0,>=1.0.0 (from poetry) Downloading pyproject_hooks-1.0.0-py3-none-any.whl.metadata (1.3 kB) Collecting requests<3.0,>=2.26 (from poetry) Downloading requests-2.31.0-py3-none-any.whl.metadata (4.6 kB) Collecting requests-toolbelt<2.0.0,>=1.0.0 (from poetry) Downloading requests_toolbelt-1.0.0-py2.py3-none-any.whl.metadata (14 kB) Collecting shellingham<2.0,>=1.5 (from poetry) Downloading shellingham-1.5.4-py2.py3-none-any.whl.metadata (3.5 kB) Collecting tomlkit<1.0.0,>=0.11.4 (from poetry) Downloading tomlkit-0.12.4-py3-none-any.whl.metadata (2.7 kB) Collecting trove-classifiers>=2022.5.19 (from poetry) Downloading trove_classifiers-2024.3.25-py3-none-any.whl.metadata (2.2 kB) Collecting virtualenv<21.0.0,>=20.23.0 (from poetry) Downloading virtualenv-20.25.1-py3-none-any.whl.metadata (4.4 kB) Collecting msgpack<2.0.0,>=0.5.2 (from cachecontrol<0.15.0,>=0.14.0->cachecontrol[filecache]<0.15.0,>=0.14.0->poetry) Downloading msgpack-1.0.8-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (9.1 kB) Collecting filelock>=3.8.0 (from cachecontrol[filecache]<0.15.0,>=0.14.0->poetry) Downloading filelock-3.13.3-py3-none-any.whl.metadata (2.8 kB) Collecting rapidfuzz<4.0.0,>=3.0.0 (from cleo<3.0.0,>=2.1.0->poetry) Downloading rapidfuzz-3.7.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (11 kB) Collecting urllib3>=1.25 (from dulwich<0.22.0,>=0.21.2->poetry) Downloading urllib3-2.2.1-py3-none-any.whl.metadata (6.4 kB) Collecting jaraco.classes (from keyring<25.0.0,>=24.0.0->poetry) Downloading jaraco.classes-3.4.0-py3-none-any.whl.metadata (2.6 kB) Collecting importlib-metadata>=4.11.4 (from keyring<25.0.0,>=24.0.0->poetry) Downloading importlib_metadata-7.1.0-py3-none-any.whl.metadata (4.7 kB) Collecting SecretStorage>=3.2 (from keyring<25.0.0,>=24.0.0->poetry) Downloading SecretStorage-3.3.3-py3-none-any.whl.metadata (4.0 kB) Collecting jeepney>=0.4.2 (from keyring<25.0.0,>=24.0.0->poetry) Downloading jeepney-0.8.0-py3-none-any.whl.metadata (1.3 kB) Collecting ptyprocess>=0.5 (from pexpect<5.0.0,>=4.7.0->poetry) Downloading ptyprocess-0.7.0-py2.py3-none-any.whl.metadata (1.3 kB) Collecting charset-normalizer<4,>=2 (from requests<3.0,>=2.26->poetry) Downloading charset_normalizer-3.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (33 kB) Collecting idna<4,>=2.5 (from requests<3.0,>=2.26->poetry) Downloading idna-3.6-py3-none-any.whl.metadata (9.9 kB) Collecting certifi>=2017.4.17 (from requests<3.0,>=2.26->poetry) Downloading certifi-2024.2.2-py3-none-any.whl.metadata (2.2 kB) Collecting distlib<1,>=0.3.7 (from virtualenv<21.0.0,>=20.23.0->poetry) Downloading distlib-0.3.8-py2.py3-none-any.whl.metadata (5.1 kB) Collecting zipp>=0.5 (from importlib-metadata>=4.11.4->keyring<25.0.0,>=24.0.0->poetry) Downloading zipp-3.18.1-py3-none-any.whl.metadata (3.5 kB) Collecting cryptography>=2.0 (from SecretStorage>=3.2->keyring<25.0.0,>=24.0.0->poetry) Downloading cryptography-42.0.5-cp39-abi3-manylinux_2_28_x86_64.whl.metadata (5.3 kB) Collecting more-itertools (from jaraco.classes->keyring<25.0.0,>=24.0.0->poetry) Downloading more_itertools-10.2.0-py3-none-any.whl.metadata (34 kB) Collecting cffi>=1.12 (from cryptography>=2.0->SecretStorage>=3.2->keyring<25.0.0,>=24.0.0->poetry) Downloading cffi-1.16.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (1.5 kB) Collecting pycparser (from cffi>=1.12->cryptography>=2.0->SecretStorage>=3.2->keyring<25.0.0,>=24.0.0->poetry) Downloading pycparser-2.22-py3-none-any.whl.metadata (943 bytes) Downloading poetry-1.8.2-py3-none-any.whl (249 kB) ââââââââââââââââââââââââââââââââââââââââ 249.4/249.4 kB 2.5 MB/s eta 0:00:00 Downloading poetry_core-1.9.0-py3-none-any.whl (309 kB) ââââââââââââââââââââââââââââââââââââââââ 309.5/309.5 kB 2.2 MB/s eta 0:00:00 Downloading build-1.2.1-py3-none-any.whl (21 kB) Downloading cachecontrol-0.14.0-py3-none-any.whl (22 kB) Downloading cleo-2.1.0-py3-none-any.whl (78 kB) ââââââââââââââââââââââââââââââââââââââââ 78.7/78.7 kB 2.7 MB/s eta 0:00:00 Downloading crashtest-0.4.1-py3-none-any.whl (7.6 kB) Downloading dulwich-0.21.7-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (516 kB) ââââââââââââââââââââââââââââââââââââââââ 516.4/516.4 kB 2.5 MB/s eta 0:00:00 Downloading fastjsonschema-2.19.1-py3-none-any.whl (23 kB) Downloading installer-0.7.0-py3-none-any.whl (453 kB) ââââââââââââââââââââââââââââââââââââââââ 453.8/453.8 kB 3.1 MB/s eta 0:00:00 Downloading keyring-24.3.1-py3-none-any.whl (38 kB) Downloading packaging-24.0-py3-none-any.whl (53 kB) ââââââââââââââââââââââââââââââââââââââââ 53.5/53.5 kB 2.9 MB/s eta 0:00:00 Downloading pexpect-4.9.0-py2.py3-none-any.whl (63 kB) ââââââââââââââââââââââââââââââââââââââââ 63.8/63.8 kB 3.8 MB/s eta 0:00:00 Downloading pkginfo-1.10.0-py3-none-any.whl (30 kB) Downloading platformdirs-4.2.0-py3-none-any.whl (17 kB) Downloading poetry_plugin_export-1.7.1-py3-none-any.whl (10 kB) Downloading pyproject_hooks-1.0.0-py3-none-any.whl (9.3 kB) Downloading requests-2.31.0-py3-none-any.whl (62 kB) ââââââââââââââââââââââââââââââââââââââââ 62.6/62.6 kB 3.8 MB/s eta 0:00:00 Downloading requests_toolbelt-1.0.0-py2.py3-none-any.whl (54 kB) ââââââââââââââââââââââââââââââââââââââââ 54.5/54.5 kB 3.2 MB/s eta 0:00:00 Downloading shellingham-1.5.4-py2.py3-none-any.whl (9.8 kB) Downloading tomlkit-0.12.4-py3-none-any.whl (37 kB) Downloading trove_classifiers-2024.3.25-py3-none-any.whl (13 kB) Downloading virtualenv-20.25.1-py3-none-any.whl (3.8 MB) ââââââââââââââââââââââââââââââââââââââââ 3.8/3.8 MB 4.7 MB/s eta 0:00:00 Downloading certifi-2024.2.2-py3-none-any.whl (163 kB) ââââââââââââââââââââââââââââââââââââââââ 163.8/163.8 kB 9.0 MB/s eta 0:00:00 Downloading charset_normalizer-3.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (140 kB) ââââââââââââââââââââââââââââââââââââââââ 140.3/140.3 kB 8.1 MB/s eta 0:00:00 Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) ââââââââââââââââââââââââââââââââââââââââ 468.9/468.9 kB 4.4 MB/s eta 0:00:00 Downloading filelock-3.13.3-py3-none-any.whl (11 kB) Downloading idna-3.6-py3-none-any.whl (61 kB) ââââââââââââââââââââââââââââââââââââââââ 61.6/61.6 kB 3.3 MB/s eta 0:00:00 Downloading importlib_metadata-7.1.0-py3-none-any.whl (24 kB) Downloading jeepney-0.8.0-py3-none-any.whl (48 kB) ââââââââââââââââââââââââââââââââââââââââ 48.4/48.4 kB 2.7 MB/s eta 0:00:00 Downloading msgpack-1.0.8-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (409 kB) ââââââââââââââââââââââââââââââââââââââââ 409.3/409.3 kB 4.1 MB/s eta 0:00:00 Downloading ptyprocess-0.7.0-py2.py3-none-any.whl (13 kB) Downloading rapidfuzz-3.7.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.4 MB) ââââââââââââââââââââââââââââââââââââââââ 3.4/3.4 MB 3.6 MB/s eta 0:00:00 Downloading SecretStorage-3.3.3-py3-none-any.whl (15 kB) Downloading urllib3-2.2.1-py3-none-any.whl (121 kB) ââââââââââââââââââââââââââââââââââââââââ 121.1/121.1 kB 6.4 MB/s eta 0:00:00 Downloading jaraco.classes-3.4.0-py3-none-any.whl (6.8 kB) Downloading cryptography-42.0.5-cp39-abi3-manylinux_2_28_x86_64.whl (4.6 MB) ââââââââââââââââââââââââââââââââââââââââ 4.6/4.6 MB 4.9 MB/s eta 0:00:00 Downloading zipp-3.18.1-py3-none-any.whl (8.2 kB) Downloading more_itertools-10.2.0-py3-none-any.whl (57 kB) ââââââââââââââââââââââââââââââââââââââââ 57.0/57.0 kB 5.4 MB/s eta 0:00:00 Downloading cffi-1.16.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (464 kB) ââââââââââââââââââââââââââââââââââââââââ 464.8/464.8 kB 7.2 MB/s eta 0:00:00 Downloading pycparser-2.22-py3-none-any.whl (117 kB) ââââââââââââââââââââââââââââââââââââââââ 117.6/117.6 kB 6.2 MB/s eta 0:00:00 Installing collected packages: trove-classifiers, ptyprocess, fastjsonschema, distlib, zipp, urllib3, tomlkit, shellingham, rapidfuzz, pyproject-hooks, pycparser, poetry-core, platformdirs, pkginfo, pexpect, packaging, msgpack, more-itertools, jeepney, installer, idna, filelock, crashtest, charset-normalizer, certifi, virtualenv, requests, jaraco.classes, importlib-metadata, dulwich, cleo, cffi, build, requests-toolbelt, cryptography, cachecontrol, SecretStorage, keyring, poetry-plugin-export, poetry Successfully installed SecretStorage-3.3.3 build-1.2.1 cachecontrol-0.14.0 certifi-2024.2.2 cffi-1.16.0 charset-normalizer-3.3.2 cleo-2.1.0 crashtest-0.4.1 cryptography-42.0.5 distlib-0.3.8 dulwich-0.21.7 fastjsonschema-2.19.1 filelock-3.13.3 idna-3.6 importlib-metadata-7.1.0 installer-0.7.0 jaraco.classes-3.4.0 jeepney-0.8.0 keyring-24.3.1 more-itertools-10.2.0 msgpack-1.0.8 packaging-24.0 pexpect-4.9.0 pkginfo-1.10.0 platformdirs-4.2.0 poetry-1.8.2 poetry-core-1.9.0 poetry-plugin-export-1.7.1 ptyprocess-0.7.0 pycparser-2.22 pyproject-hooks-1.0.0 rapidfuzz-3.7.0 requests-2.31.0 requests-toolbelt-1.0.0 shellingham-1.5.4 tomlkit-0.12.4 trove-classifiers-2024.3.25 urllib3-2.2.1 virtualenv-20.25.1 zipp-3.18.1 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv [4/9] ADD ../pyproject.toml ../poetry.lock ./ [5/9] RUN poetry install --no-root --no-ansi --with worker,api --without ai,streamlit-app,ingester,dev Creating virtualenv redbox-il7asoJj-py3.11 in /root/.cache/pypoetry/virtualenvs Installing dependencies from lock file Package operations:129 installs, 1 update, 0 removals - Installing six (1.16.0) - Installing markupsafe (2.1.5) - Installing mdurl (0.1.2) - Installing python-dateutil (2.8.2) - Installing pyyaml (6.0.1) - Installing typing-extensions (4.9.0) - Installing annotated-types (0.6.0) - Installing certifi (2024.2.2) - Installing charset-normalizer (3.3.2) - Installing ghp-import (2.1.0) - Installing idna (3.6) - Installing markdown (3.5.2) - Installing jinja2 (3.1.3) - Installing mergedeep (1.3.4) - Installing pathspec (0.12.1) - Installing platformdirs (4.2.0) - Installing packaging (23.2) - Installing pydantic-core (2.16.3) - Installing click (8.1.7) - Installing pyyaml-env-tag (0.1) - Installing markdown-it-py (3.0.0) - Installing pygments (2.17.2) - Installing watchdog (4.0.0) - Installing urllib3 (1.26.18) - Installing filelock (3.13.1) - Installing frozenlist (1.4.1) - Installing fsspec (2024.2.0) - Installing jsonpointer (2.4) - Installing multidict (6.0.5) - Installing nvidia-nvjitlink-cu12 (12.4.99) - Installing orjson (3.10.0) - Installing mypy-extensions (1.0.0) - Installing mkdocs (1.5.3) - Installing shellingham (1.5.4) - Installing requests (2.31.0) - Installing rich (13.7.1) - Installing tqdm (4.66.2) - Installing pydantic (2.6.4) - Installing aiosignal (1.3.1) - Installing attrs (23.2.0) - Installing colorama (0.4.6) - Installing greenlet (3.0.3) - Installing huggingface-hub (0.20.3) - Installing jmespath (1.0.1) - Installing langsmith (0.1.39) - Installing jsonpatch (1.33) - Installing marshmallow (3.20.2) - Installing mpmath (1.3.0) - Installing numpy (1.26.4) - Installing nvidia-cublas-cu12 (12.1.3.1) - Installing mkdocs-autorefs (1.0.1) - Installing sniffio (1.3.1) - Installing tenacity (8.2.3) - Installing pymdown-extensions (10.7.1) - Installing typing-inspect (0.9.0) - Installing typer-slim (0.12.0) - Installing nvidia-cusparse-cu12 (12.1.0.106) - Installing yarl (1.9.4) Installing /root/.cache/pypoetry/virtualenvs/redbox-il7asoJj-py3.11/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /root/.cache/pypoetry/virtualenvs/redbox-il7asoJj-py3.11/lib/python3.11/site-packages/nvidia/__init__.py over existing file - Installing aiohttp (3.9.3) - Installing anyio (4.3.0) - Installing babel (2.14.0) - Installing dataclasses-json (0.6.4) - Installing botocore (1.34.77) - Installing joblib (1.3.2) - Installing editorconfig (0.12.4) - Installing griffe (0.42.1) - Installing langchain-core (0.1.39) - Installing networkx (3.2.1) - Installing nvidia-cuda-nvrtc-cu12 (12.1.105) - Installing log-symbols (0.0.14) - Installing nvidia-cudnn-cu12 (8.9.2.26) - Installing mkdocs-material-extensions (1.3.1) - Installing nvidia-curand-cu12 (10.3.2.106) - Installing nvidia-cuda-cupti-cu12 (12.1.105) - Installing nvidia-cuda-runtime-cu12 (12.1.105) - Installing mkdocstrings (0.24.2) - Installing nvidia-cufft-cu12 (11.0.2.54) - Installing nvidia-cusolver-cu12 (11.4.5.107) - Installing nvidia-nccl-cu12 (2.19.3) - Installing nvidia-nvtx-cu12 (12.1.105) - Installing paginate (0.5.6) - Installing regex (2023.12.25) - Installing safetensors (0.3.2) - Installing scipy (1.10.1) Installing /root/.cache/pypoetry/virtualenvs/redbox-il7asoJj-py3.11/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /root/.cache/pypoetry/virtualenvs/redbox-il7asoJj-py3.11/lib/python3.11/site-packages/nvidia/__init__.py over existing file - Installing soupsieve (2.5) - Installing spinners (0.0.24) - Installing sqlalchemy (2.0.29) - Installing sympy (1.12) - Installing termcolor (2.4.0) - Installing threadpoolctl (3.4.0) - Installing tokenizers (0.15.2) - Installing triton (2.2.0) - Installing typer-cli (0.12.0) Installing /root/.cache/pypoetry/virtualenvs/redbox-il7asoJj-py3.11/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /root/.cache/pypoetry/virtualenvs/redbox-il7asoJj-py3.11/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /root/.cache/pypoetry/virtualenvs/redbox-il7asoJj-py3.11/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /root/.cache/pypoetry/virtualenvs/redbox-il7asoJj-py3.11/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /root/.cache/pypoetry/virtualenvs/redbox-il7asoJj-py3.11/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /root/.cache/pypoetry/virtualenvs/redbox-il7asoJj-py3.11/lib/python3.11/site-packages/nvidia/__init__.py over existing file Installing /root/.cache/pypoetry/virtualenvs/redbox-il7asoJj-py3.11/lib/python3.11/site-packages/nvidia/__init__.py over existing file - Installing beautifulsoup4 (4.12.3) - Installing bump2version (1.0.1) - Installing elastic-transport (8.13.0) - Installing fast-depends (2.4.2) - Installing h11 (0.14.0) - Installing jsbeautifier (1.15.1) - Installing langchain-text-splitters (0.0.1) - Installing mkdocs-material (9.5.17) - Installing halo (0.0.31) - Installing pillow (10.2.0) - Installing langchain-community (0.0.31) - Installing mkdocstrings-python (1.9.2) - Installing scikit-learn (1.4.1.post1) - Installing starlette (0.37.2) - Installing tabulate (0.9.0) - Installing torch (2.2.0) - Updating setuptools (69.1.0 -> 69.2.0) - Installing redis (5.0.3) - Installing python-dotenv (1.0.1) - Installing s3transfer (0.10.1) - Installing transformers (4.37.1) - Installing typer (0.12.0) - Installing boto3 (1.34.77) - Installing bumpversion (0.6.0) - Installing fastapi (0.110.1) - Installing faststream (0.4.7) - Installing elasticsearch (8.13.0) - Installing langchain (0.1.14) - Installing mkapi (2.1.0) - Installing mkdocs-mermaid2-plugin (1.1.1) - Installing markdown-mdantic (2.1.0) - Installing pika (1.3.2) - Installing pydantic-settings (2.2.1) - Installing sentence-transformers (2.6.1) - Installing python-multipart (0.0.9) - Installing tiktoken (0.6.0) - Installing uvicorn (0.29.0) [6/9] ADD ./redbox /app/redbox [7/9] ADD ./Makefile /app/ [8/9] ADD ./.env.example /app/ [9/9] WORKDIR /app/ exporting to image exporting layers 0/0 78.864 writing image sha256:932a53a35bdc73920a3db01b933e0f4838d5f9be4357956bc5be069b99dc5755 0/0 0.006 naming to docker.io/library/redbox-tests:latest 0/0 0.007 ```

gecBurton commented 7 months ago

thx for the detailed logs and fair point re: telling you what services you need! the core services (at the moment) are:

core-api
embedder
ingester

and you will need some chat interface , which right now, is best served by streamlit-app

The above builds in CI on standard GH runners. I am afk at the moment but will be able to dig into your issue properly tomorrow.

wpfl-dbt commented 7 months ago

Hero, ta 😄 . I'll run those four and see how I go.

wpfl-dbt commented 7 months ago

I did another prune then ran docker compose up core-api embedder ingester streamlit-app which in turn brings up redis, elasticsearch and minio, which you'd expect. This at least works, though the docker engine's total reported disk usage (containers plus overheads) is 45Gb!

This is a separate issue, but steamlit-app fails as it can't import model_db. Will raise in another thread.

Something that might be useful is to use profiles to make the compose a bit more explicit. Get to something like docker compose --profile backend --profile frontend_streamlit up. Again, happy to raise a feature request if this sounds like a good idea.

gecBurton commented 7 months ago

yep. this is an excellent idea, please raise away!

peterkwells commented 7 months ago

hello, same issue here - temporarily resolved by expanding disk space available to Docker. In case it's helpful here's the amount of space being used by the various images.

On desktop, also running MacOS 14.4.1 (23E224)

gecBurton commented 7 months ago

This is not the answer, but it is a step in the right direction https://github.com/i-dot-ai/redbox-copilot/pull/200

wpfl-dbt commented 7 months ago

I just pruned and ran docker compose build --no-cache core-api embedded ingester streamlit-app this morning, and just before the images exported Docker was reporting a full 60Gb or so of disk usage which went down to 40Gb after the export.

1lliter8 commented 7 months ago

Some insights on this ticket after working in streamlit for a while:

Lots of services use a builder/runtime from a common poetry lockfile. Can we use docker extensions to extend this pattern to the entire compose, then use poetry sync to customise for each service. It might not save much space, but it'll definitely save time
Check out poetry show --tree -- sentence-transformers has a dependency on PyTorch, and even though we're developing on CPU, it's installing 2-3Gb of Nvidia GPU dependencies. I switched the streamlit repo to CPU inference, but you have an issue that many of us are developing on Mac, but it runs on Debian, and PyTorch has different install processes for both which poetry doesn't like. I sorted by switching to dev containers, but it's a bit vendor lockin-y
- Seems sys-platform markers are supported by poetry so maybe there's a non-dev-container route to this too

wpfl-dbt commented 4 months ago

i-dot-ai / redbox

No space left on device #179

680 should solve this.