search

modal-labs / modal-examples

Examples of programs built using Modal
https://modal.com/docs
MIT License
692 stars 159 forks source link

trtllm_llama example doesn't correctly deploy #822

Closed florin-pop closed 1 month ago

florin-pop commented 1 month ago

When running:

git clone https://github.com/modal-labs/modal-examples
cd modal-examples
modal run 06_gpu_and_ml/llm-serving/trtllm_llama.py

An image is correctly created, but it looks like the deployment is looking for a different image. Logs:

Building image im-WWDmNATDuibFyAD7mAqXe1

=> Step 0: FROM nvidia/cuda:12.1.1-devel-ubuntu22.04
Getting image source signatures
Copying blob sha256:a14a8a8a6ebc3813d37a448205bf2c059e7b0dde5dda741babfffc327f32638c
Copying blob sha256:1532d9024b9c102cb1b19cfd585e8735a1efc882bfa9243f6662b47e033c0c2c
Copying blob sha256:aece8493d3972efa43bfd4ee3cdba659c0f787f8f59c82fb3e48c87cbb22a12e
Copying blob sha256:04fc8a31fa53f7fd9ba45a2d109618449fd5f9d9b3f12d1cf961f4c0a0a34500
Copying blob sha256:b0d7cc89b769c1d6a46d85393516b303afeeee8d8bcbcdadb9cc9a452728cf27
Copying blob sha256:dd4939a047617694ff7585d2d828e574bcdb1a0e870d41ba1abad6db61fca814
Copying blob sha256:7d61afc7a3ac0a2b20643507f9ed50f42939d6838db55de1736527a711e98038
Copying blob sha256:8bd2762ffdd9e59311bc1d8909932d3363ca4897858f7f71aa837969b22754d8
Copying blob sha256:2a5ee6fadd42bc8a2088ecb52dc294274388aaa285d21507e399dbebfdb54f49
Copying blob sha256:22ba0fb08ae2d48e74c162458e138662946b32e12d711832122e465210ecbee8
Copying blob sha256:4d37a6bba88ff56fdbfcacd9ed2e4c2030b712adb162e0efa69b82ca7220a069
Copying config sha256:b4fa2f095f0016c5c1f85b1bcc1762622a0227d9894d77b4c3f49129f81786f3
Writing manifest to image destination
Unpacking OCI image
   • unpacking rootfs ...
   • ... done
   • unpacked image rootfs: /tmp/.tmptbxqrR

=> Step 1: COPY /python/. /usr/local

=> Step 2: RUN ln -s /usr/local/bin/python3 /usr/local/bin/python

=> Step 3: ENV TERMINFO_DIRS=/etc/terminfo:/lib/terminfo:/usr/share/terminfo:/usr/lib/terminfo

=> Step 4: COPY /modal_requirements.txt /modal_requirements.txt

=> Step 5: RUN python -m pip install --upgrade pip
Looking in indexes: http://pypi-mirror.modal.local:5555/simple
Requirement already satisfied: pip in /usr/local/lib/python3.10/site-packages (23.2.1)
Collecting pip
  Obtaining dependency information for pip from http://pypi-mirror.modal.local:5555/simple/pip/pip-24.1.2-py3-none-any.whl.metadata
  Downloading http://pypi-mirror.modal.local:5555/simple/pip/pip-24.1.2-py3-none-any.whl.metadata (3.6 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/pip/pip-24.1.2-py3-none-any.whl (1.8 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.8/1.8 MB 207.9 MB/s eta 0:00:00
Installing collected packages: pip
  Attempting uninstall: pip
    Found existing installation: pip 23.2.1
    Uninstalling pip-23.2.1:
      Successfully uninstalled pip-23.2.1
Successfully installed pip-24.1.2

=> Step 6: RUN python -m pip install -r /modal_requirements.txt
Looking in indexes: http://pypi-mirror.modal.local:5555/simple
Ignoring cloudpickle: markers 'python_version >= "3.11"' don't match your environment
Collecting aiohttp==3.8.3 (from -r /modal_requirements.txt (line 2))
  Downloading http://pypi-mirror.modal.local:5555/simple/aiohttp/aiohttp-3.8.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (7.4 kB)
Collecting aiostream==0.4.4 (from -r /modal_requirements.txt (line 3))
  Downloading http://pypi-mirror.modal.local:5555/simple/aiostream/aiostream-0.4.4.tar.gz (32 kB)
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
Collecting asgiref==3.5.2 (from -r /modal_requirements.txt (line 4))
  Downloading http://pypi-mirror.modal.local:5555/simple/asgiref/asgiref-3.5.2-py3-none-any.whl.metadata (9.1 kB)
Collecting certifi>=2022.12.07 (from -r /modal_requirements.txt (line 5))
  Downloading http://pypi-mirror.modal.local:5555/simple/certifi/certifi-2024.7.4-py3-none-any.whl.metadata (2.2 kB)
Collecting cloudpickle==2.0.0 (from -r /modal_requirements.txt (line 6))
  Downloading http://pypi-mirror.modal.local:5555/simple/cloudpickle/cloudpickle-2.0.0-py3-none-any.whl.metadata (6.9 kB)
Collecting ddtrace==1.5.2 (from -r /modal_requirements.txt (line 8))
  Downloading http://pypi-mirror.modal.local:5555/simple/ddtrace/ddtrace-1.5.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.0 kB)
Collecting fastapi==0.88.0 (from -r /modal_requirements.txt (line 9))
  Downloading http://pypi-mirror.modal.local:5555/simple/fastapi/fastapi-0.88.0-py3-none-any.whl.metadata (24 kB)
Collecting fastprogress==1.0.0 (from -r /modal_requirements.txt (line 10))
  Downloading http://pypi-mirror.modal.local:5555/simple/fastprogress/fastprogress-1.0.0-py3-none-any.whl.metadata (5.5 kB)
Collecting grpclib==0.4.3 (from -r /modal_requirements.txt (line 11))
  Downloading http://pypi-mirror.modal.local:5555/simple/grpclib/grpclib-0.4.3.tar.gz (62 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.1/62.1 kB 217.6 MB/s eta 0:00:00
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
Collecting importlib_metadata==4.8.1 (from -r /modal_requirements.txt (line 12))
  Downloading http://pypi-mirror.modal.local:5555/simple/importlib-metadata/importlib_metadata-4.8.1-py3-none-any.whl.metadata (4.0 kB)
Collecting ipython>=7.34.0 (from -r /modal_requirements.txt (line 13))
  Downloading http://pypi-mirror.modal.local:5555/simple/ipython/ipython-8.26.0-py3-none-any.whl.metadata (5.0 kB)
Collecting protobuf>=3.19.0 (from -r /modal_requirements.txt (line 14))
  Downloading http://pypi-mirror.modal.local:5555/simple/protobuf/protobuf-5.27.2-cp38-abi3-manylinux2014_x86_64.whl.metadata (592 bytes)
Collecting python-multipart>=0.0.5 (from -r /modal_requirements.txt (line 15))
  Downloading http://pypi-mirror.modal.local:5555/simple/python-multipart/python_multipart-0.0.9-py3-none-any.whl.metadata (2.5 kB)
Collecting rich==12.3.0 (from -r /modal_requirements.txt (line 16))
  Downloading http://pypi-mirror.modal.local:5555/simple/rich/rich-12.3.0-py3-none-any.whl.metadata (19 kB)
Collecting tblib==1.7.0 (from -r /modal_requirements.txt (line 17))
  Downloading http://pypi-mirror.modal.local:5555/simple/tblib/tblib-1.7.0-py2.py3-none-any.whl.metadata (24 kB)
Collecting toml==0.10.2 (from -r /modal_requirements.txt (line 18))
  Downloading http://pypi-mirror.modal.local:5555/simple/toml/toml-0.10.2-py2.py3-none-any.whl.metadata (7.1 kB)
Collecting typer==0.6.1 (from -r /modal_requirements.txt (line 19))
  Downloading http://pypi-mirror.modal.local:5555/simple/typer/typer-0.6.1-py3-none-any.whl.metadata (17 kB)
Collecting types-certifi==2021.10.8.3 (from -r /modal_requirements.txt (line 20))
  Downloading http://pypi-mirror.modal.local:5555/simple/types-certifi/types_certifi-2021.10.8.3-py3-none-any.whl.metadata (1.4 kB)
Collecting types-toml==0.10.4 (from -r /modal_requirements.txt (line 21))
  Downloading http://pypi-mirror.modal.local:5555/simple/types-toml/types_toml-0.10.4-py3-none-any.whl.metadata (1.1 kB)
Collecting typeguard>=3.0.0 (from -r /modal_requirements.txt (line 22))
  Downloading http://pypi-mirror.modal.local:5555/simple/typeguard/typeguard-4.3.0-py3-none-any.whl.metadata (3.7 kB)
Collecting attrs>=17.3.0 (from aiohttp==3.8.3->-r /modal_requirements.txt (line 2))
  Downloading http://pypi-mirror.modal.local:5555/simple/attrs/attrs-23.2.0-py3-none-any.whl.metadata (9.5 kB)
Collecting charset-normalizer<3.0,>=2.0 (from aiohttp==3.8.3->-r /modal_requirements.txt (line 2))
  Downloading http://pypi-mirror.modal.local:5555/simple/charset-normalizer/charset_normalizer-2.1.1-py3-none-any.whl.metadata (11 kB)
Collecting multidict<7.0,>=4.5 (from aiohttp==3.8.3->-r /modal_requirements.txt (line 2))
  Downloading http://pypi-mirror.modal.local:5555/simple/multidict/multidict-6.0.5-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.2 kB)
Collecting async-timeout<5.0,>=4.0.0a3 (from aiohttp==3.8.3->-r /modal_requirements.txt (line 2))
  Downloading http://pypi-mirror.modal.local:5555/simple/async-timeout/async_timeout-4.0.3-py3-none-any.whl.metadata (4.2 kB)
Collecting yarl<2.0,>=1.0 (from aiohttp==3.8.3->-r /modal_requirements.txt (line 2))
  Downloading http://pypi-mirror.modal.local:5555/simple/yarl/yarl-1.9.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (31 kB)
Collecting frozenlist>=1.1.1 (from aiohttp==3.8.3->-r /modal_requirements.txt (line 2))
  Downloading http://pypi-mirror.modal.local:5555/simple/frozenlist/frozenlist-1.4.1-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (12 kB)
Collecting aiosignal>=1.1.2 (from aiohttp==3.8.3->-r /modal_requirements.txt (line 2))
  Downloading http://pypi-mirror.modal.local:5555/simple/aiosignal/aiosignal-1.3.1-py3-none-any.whl.metadata (4.0 kB)
Collecting ddsketch>=2.0.1 (from ddtrace==1.5.2->-r /modal_requirements.txt (line 8))
  Downloading http://pypi-mirror.modal.local:5555/simple/ddsketch/ddsketch-3.0.1-py3-none-any.whl.metadata (5.4 kB)
Collecting packaging>=17.1 (from ddtrace==1.5.2->-r /modal_requirements.txt (line 8))
  Downloading http://pypi-mirror.modal.local:5555/simple/packaging/packaging-24.1-py3-none-any.whl.metadata (3.2 kB)
Collecting tenacity>=5 (from ddtrace==1.5.2->-r /modal_requirements.txt (line 8))
  Downloading http://pypi-mirror.modal.local:5555/simple/tenacity/tenacity-8.5.0-py3-none-any.whl.metadata (1.2 kB)
Collecting cattrs (from ddtrace==1.5.2->-r /modal_requirements.txt (line 8))
  Downloading http://pypi-mirror.modal.local:5555/simple/cattrs/cattrs-23.2.3-py3-none-any.whl.metadata (10 kB)
Collecting six>=1.12.0 (from ddtrace==1.5.2->-r /modal_requirements.txt (line 8))
  Downloading http://pypi-mirror.modal.local:5555/simple/six/six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB)
Collecting typing-extensions (from ddtrace==1.5.2->-r /modal_requirements.txt (line 8))
  Downloading http://pypi-mirror.modal.local:5555/simple/typing-extensions/typing_extensions-4.12.2-py3-none-any.whl.metadata (3.0 kB)
Collecting jsonschema (from ddtrace==1.5.2->-r /modal_requirements.txt (line 8))
  Downloading http://pypi-mirror.modal.local:5555/simple/jsonschema/jsonschema-4.23.0-py3-none-any.whl.metadata (7.9 kB)
Collecting xmltodict>=0.12 (from ddtrace==1.5.2->-r /modal_requirements.txt (line 8))
  Downloading http://pypi-mirror.modal.local:5555/simple/xmltodict/xmltodict-0.13.0-py2.py3-none-any.whl.metadata (7.7 kB)
Collecting envier (from ddtrace==1.5.2->-r /modal_requirements.txt (line 8))
  Downloading http://pypi-mirror.modal.local:5555/simple/envier/envier-0.5.2-py3-none-any.whl.metadata (4.6 kB)
Collecting bytecode (from ddtrace==1.5.2->-r /modal_requirements.txt (line 8))
  Downloading http://pypi-mirror.modal.local:5555/simple/bytecode/bytecode-0.15.1-py3-none-any.whl.metadata (4.6 kB)
Collecting pydantic!=1.7,!=1.7.1,!=1.7.2,!=1.7.3,!=1.8,!=1.8.1,<2.0.0,>=1.6.2 (from fastapi==0.88.0->-r /modal_requirements.txt (line 9))
  Downloading http://pypi-mirror.modal.local:5555/simple/pydantic/pydantic-1.10.17-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (151 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 151.6/151.6 kB 98.6 MB/s eta 0:00:00
Collecting starlette==0.22.0 (from fastapi==0.88.0->-r /modal_requirements.txt (line 9))
  Downloading http://pypi-mirror.modal.local:5555/simple/starlette/starlette-0.22.0-py3-none-any.whl.metadata (5.8 kB)
Collecting numpy (from fastprogress==1.0.0->-r /modal_requirements.txt (line 10))
  Downloading http://pypi-mirror.modal.local:5555/simple/numpy/numpy-2.0.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (60 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 60.9/60.9 kB 216.1 MB/s eta 0:00:00
Collecting h2<5,>=3.1.0 (from grpclib==0.4.3->-r /modal_requirements.txt (line 11))
  Downloading http://pypi-mirror.modal.local:5555/simple/h2/h2-4.1.0-py3-none-any.whl.metadata (3.6 kB)
Collecting zipp>=0.5 (from importlib_metadata==4.8.1->-r /modal_requirements.txt (line 12))
  Downloading http://pypi-mirror.modal.local:5555/simple/zipp/zipp-3.19.2-py3-none-any.whl.metadata (3.6 kB)
Collecting commonmark<0.10.0,>=0.9.0 (from rich==12.3.0->-r /modal_requirements.txt (line 16))
  Downloading http://pypi-mirror.modal.local:5555/simple/commonmark/commonmark-0.9.1-py2.py3-none-any.whl.metadata (5.7 kB)
Collecting pygments<3.0.0,>=2.6.0 (from rich==12.3.0->-r /modal_requirements.txt (line 16))
  Downloading http://pypi-mirror.modal.local:5555/simple/pygments/pygments-2.18.0-py3-none-any.whl.metadata (2.5 kB)
Collecting click<9.0.0,>=7.1.1 (from typer==0.6.1->-r /modal_requirements.txt (line 19))
  Downloading http://pypi-mirror.modal.local:5555/simple/click/click-8.1.7-py3-none-any.whl.metadata (3.0 kB)
Collecting anyio<5,>=3.4.0 (from starlette==0.22.0->fastapi==0.88.0->-r /modal_requirements.txt (line 9))
  Downloading http://pypi-mirror.modal.local:5555/simple/anyio/anyio-4.4.0-py3-none-any.whl.metadata (4.6 kB)
Collecting decorator (from ipython>=7.34.0->-r /modal_requirements.txt (line 13))
  Downloading http://pypi-mirror.modal.local:5555/simple/decorator/decorator-5.1.1-py3-none-any.whl.metadata (4.0 kB)
Collecting jedi>=0.16 (from ipython>=7.34.0->-r /modal_requirements.txt (line 13))
  Downloading http://pypi-mirror.modal.local:5555/simple/jedi/jedi-0.19.1-py2.py3-none-any.whl.metadata (22 kB)
Collecting matplotlib-inline (from ipython>=7.34.0->-r /modal_requirements.txt (line 13))
  Downloading http://pypi-mirror.modal.local:5555/simple/matplotlib-inline/matplotlib_inline-0.1.7-py3-none-any.whl.metadata (3.9 kB)
Collecting prompt-toolkit<3.1.0,>=3.0.41 (from ipython>=7.34.0->-r /modal_requirements.txt (line 13))
  Downloading http://pypi-mirror.modal.local:5555/simple/prompt-toolkit/prompt_toolkit-3.0.47-py3-none-any.whl.metadata (6.4 kB)
Collecting stack-data (from ipython>=7.34.0->-r /modal_requirements.txt (line 13))
  Downloading http://pypi-mirror.modal.local:5555/simple/stack-data/stack_data-0.6.3-py3-none-any.whl.metadata (18 kB)
Collecting traitlets>=5.13.0 (from ipython>=7.34.0->-r /modal_requirements.txt (line 13))
  Downloading http://pypi-mirror.modal.local:5555/simple/traitlets/traitlets-5.14.3-py3-none-any.whl.metadata (10 kB)
Collecting exceptiongroup (from ipython>=7.34.0->-r /modal_requirements.txt (line 13))
  Downloading http://pypi-mirror.modal.local:5555/simple/exceptiongroup/exceptiongroup-1.2.2-py3-none-any.whl.metadata (6.6 kB)
Collecting pexpect>4.3 (from ipython>=7.34.0->-r /modal_requirements.txt (line 13))
  Downloading http://pypi-mirror.modal.local:5555/simple/pexpect/pexpect-4.9.0-py2.py3-none-any.whl.metadata (2.5 kB)
Collecting hyperframe<7,>=6.0 (from h2<5,>=3.1.0->grpclib==0.4.3->-r /modal_requirements.txt (line 11))
  Downloading http://pypi-mirror.modal.local:5555/simple/hyperframe/hyperframe-6.0.1-py3-none-any.whl.metadata (2.7 kB)
Collecting hpack<5,>=4.0 (from h2<5,>=3.1.0->grpclib==0.4.3->-r /modal_requirements.txt (line 11))
  Downloading http://pypi-mirror.modal.local:5555/simple/hpack/hpack-4.0.0-py3-none-any.whl.metadata (2.5 kB)
Collecting parso<0.9.0,>=0.8.3 (from jedi>=0.16->ipython>=7.34.0->-r /modal_requirements.txt (line 13))
  Downloading http://pypi-mirror.modal.local:5555/simple/parso/parso-0.8.4-py2.py3-none-any.whl.metadata (7.7 kB)
Collecting ptyprocess>=0.5 (from pexpect>4.3->ipython>=7.34.0->-r /modal_requirements.txt (line 13))
  Downloading http://pypi-mirror.modal.local:5555/simple/ptyprocess/ptyprocess-0.7.0-py2.py3-none-any.whl.metadata (1.3 kB)
Collecting wcwidth (from prompt-toolkit<3.1.0,>=3.0.41->ipython>=7.34.0->-r /modal_requirements.txt (line 13))
  Downloading http://pypi-mirror.modal.local:5555/simple/wcwidth/wcwidth-0.2.13-py2.py3-none-any.whl.metadata (14 kB)
Collecting idna>=2.0 (from yarl<2.0,>=1.0->aiohttp==3.8.3->-r /modal_requirements.txt (line 2))
  Downloading http://pypi-mirror.modal.local:5555/simple/idna/idna-3.7-py3-none-any.whl.metadata (9.9 kB)
Collecting jsonschema-specifications>=2023.03.6 (from jsonschema->ddtrace==1.5.2->-r /modal_requirements.txt (line 8))
  Downloading http://pypi-mirror.modal.local:5555/simple/jsonschema-specifications/jsonschema_specifications-2023.12.1-py3-none-any.whl.metadata (3.0 kB)
Collecting referencing>=0.28.4 (from jsonschema->ddtrace==1.5.2->-r /modal_requirements.txt (line 8))
  Downloading http://pypi-mirror.modal.local:5555/simple/referencing/referencing-0.35.1-py3-none-any.whl.metadata (2.8 kB)
Collecting rpds-py>=0.7.1 (from jsonschema->ddtrace==1.5.2->-r /modal_requirements.txt (line 8))
  Downloading http://pypi-mirror.modal.local:5555/simple/rpds-py/rpds_py-0.19.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.2 kB)
Collecting executing>=1.2.0 (from stack-data->ipython>=7.34.0->-r /modal_requirements.txt (line 13))
  Downloading http://pypi-mirror.modal.local:5555/simple/executing/executing-2.0.1-py2.py3-none-any.whl.metadata (9.0 kB)
Collecting asttokens>=2.1.0 (from stack-data->ipython>=7.34.0->-r /modal_requirements.txt (line 13))
  Downloading http://pypi-mirror.modal.local:5555/simple/asttokens/asttokens-2.4.1-py2.py3-none-any.whl.metadata (5.2 kB)
Collecting pure-eval (from stack-data->ipython>=7.34.0->-r /modal_requirements.txt (line 13))
  Downloading http://pypi-mirror.modal.local:5555/simple/pure-eval/pure_eval-0.2.3-py3-none-any.whl.metadata (6.3 kB)
Collecting sniffio>=1.1 (from anyio<5,>=3.4.0->starlette==0.22.0->fastapi==0.88.0->-r /modal_requirements.txt (line 9))
  Downloading http://pypi-mirror.modal.local:5555/simple/sniffio/sniffio-1.3.1-py3-none-any.whl.metadata (3.9 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/aiohttp/aiohttp-3.8.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.0 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.0/1.0 MB 258.4 MB/s eta 0:00:00
Downloading http://pypi-mirror.modal.local:5555/simple/asgiref/asgiref-3.5.2-py3-none-any.whl (22 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/cloudpickle/cloudpickle-2.0.0-py3-none-any.whl (25 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/ddtrace/ddtrace-1.5.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.9 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.9/3.9 MB 230.6 MB/s eta 0:00:00
Downloading http://pypi-mirror.modal.local:5555/simple/fastapi/fastapi-0.88.0-py3-none-any.whl (55 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 55.5/55.5 kB 256.8 MB/s eta 0:00:00
Downloading http://pypi-mirror.modal.local:5555/simple/fastprogress/fastprogress-1.0.0-py3-none-any.whl (12 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/importlib-metadata/importlib_metadata-4.8.1-py3-none-any.whl (17 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/rich/rich-12.3.0-py3-none-any.whl (232 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 232.1/232.1 kB 288.2 MB/s eta 0:00:00
Downloading http://pypi-mirror.modal.local:5555/simple/tblib/tblib-1.7.0-py2.py3-none-any.whl (12 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/toml/toml-0.10.2-py2.py3-none-any.whl (16 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/typer/typer-0.6.1-py3-none-any.whl (38 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/types-certifi/types_certifi-2021.10.8.3-py3-none-any.whl (2.1 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/types-toml/types_toml-0.10.4-py3-none-any.whl (4.5 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/starlette/starlette-0.22.0-py3-none-any.whl (64 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64.3/64.3 kB 225.4 MB/s eta 0:00:00
Downloading http://pypi-mirror.modal.local:5555/simple/certifi/certifi-2024.7.4-py3-none-any.whl (162 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 163.0/163.0 kB 281.1 MB/s eta 0:00:00
Downloading http://pypi-mirror.modal.local:5555/simple/ipython/ipython-8.26.0-py3-none-any.whl (817 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 817.9/817.9 kB 280.2 MB/s eta 0:00:00
Downloading http://pypi-mirror.modal.local:5555/simple/protobuf/protobuf-5.27.2-cp38-abi3-manylinux2014_x86_64.whl (309 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 309.3/309.3 kB 298.6 MB/s eta 0:00:00
Downloading http://pypi-mirror.modal.local:5555/simple/python-multipart/python_multipart-0.0.9-py3-none-any.whl (22 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/typeguard/typeguard-4.3.0-py3-none-any.whl (35 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/aiosignal/aiosignal-1.3.1-py3-none-any.whl (7.6 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/async-timeout/async_timeout-4.0.3-py3-none-any.whl (5.7 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/attrs/attrs-23.2.0-py3-none-any.whl (60 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 60.8/60.8 kB 231.6 MB/s eta 0:00:00
Downloading http://pypi-mirror.modal.local:5555/simple/charset-normalizer/charset_normalizer-2.1.1-py3-none-any.whl (39 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/click/click-8.1.7-py3-none-any.whl (97 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97.9/97.9 kB 273.6 MB/s eta 0:00:00
Downloading http://pypi-mirror.modal.local:5555/simple/commonmark/commonmark-0.9.1-py2.py3-none-any.whl (51 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 51.1/51.1 kB 208.3 MB/s eta 0:00:00
Downloading http://pypi-mirror.modal.local:5555/simple/ddsketch/ddsketch-3.0.1-py3-none-any.whl (19 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/frozenlist/frozenlist-1.4.1-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (239 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 239.5/239.5 kB 299.6 MB/s eta 0:00:00
Downloading http://pypi-mirror.modal.local:5555/simple/h2/h2-4.1.0-py3-none-any.whl (57 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.5/57.5 kB 226.2 MB/s eta 0:00:00
Downloading http://pypi-mirror.modal.local:5555/simple/jedi/jedi-0.19.1-py2.py3-none-any.whl (1.6 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.6/1.6 MB 283.0 MB/s eta 0:00:00
Downloading http://pypi-mirror.modal.local:5555/simple/multidict/multidict-6.0.5-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (124 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 124.3/124.3 kB 278.6 MB/s eta 0:00:00
Downloading http://pypi-mirror.modal.local:5555/simple/packaging/packaging-24.1-py3-none-any.whl (53 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 54.0/54.0 kB 235.4 MB/s eta 0:00:00
Downloading http://pypi-mirror.modal.local:5555/simple/pexpect/pexpect-4.9.0-py2.py3-none-any.whl (63 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 63.8/63.8 kB 242.9 MB/s eta 0:00:00
Downloading http://pypi-mirror.modal.local:5555/simple/prompt-toolkit/prompt_toolkit-3.0.47-py3-none-any.whl (386 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 386.4/386.4 kB 305.8 MB/s eta 0:00:00
Downloading http://pypi-mirror.modal.local:5555/simple/pydantic/pydantic-1.10.17-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.1 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.1/3.1 MB 275.1 MB/s eta 0:00:00
Downloading http://pypi-mirror.modal.local:5555/simple/pygments/pygments-2.18.0-py3-none-any.whl (1.2 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 283.2 MB/s eta 0:00:00
Downloading http://pypi-mirror.modal.local:5555/simple/six/six-1.16.0-py2.py3-none-any.whl (11 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/tenacity/tenacity-8.5.0-py3-none-any.whl (28 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/traitlets/traitlets-5.14.3-py3-none-any.whl (85 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 85.4/85.4 kB 263.4 MB/s eta 0:00:00
Downloading http://pypi-mirror.modal.local:5555/simple/typing-extensions/typing_extensions-4.12.2-py3-none-any.whl (37 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/xmltodict/xmltodict-0.13.0-py2.py3-none-any.whl (10.0 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/yarl/yarl-1.9.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (301 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 301.6/301.6 kB 299.4 MB/s eta 0:00:00
Downloading http://pypi-mirror.modal.local:5555/simple/zipp/zipp-3.19.2-py3-none-any.whl (9.0 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/bytecode/bytecode-0.15.1-py3-none-any.whl (39 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/cattrs/cattrs-23.2.3-py3-none-any.whl (57 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.5/57.5 kB 236.6 MB/s eta 0:00:00
Downloading http://pypi-mirror.modal.local:5555/simple/exceptiongroup/exceptiongroup-1.2.2-py3-none-any.whl (16 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/decorator/decorator-5.1.1-py3-none-any.whl (9.1 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/envier/envier-0.5.2-py3-none-any.whl (10 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/jsonschema/jsonschema-4.23.0-py3-none-any.whl (88 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 88.5/88.5 kB 236.6 MB/s eta 0:00:00
Downloading http://pypi-mirror.modal.local:5555/simple/matplotlib-inline/matplotlib_inline-0.1.7-py3-none-any.whl (9.9 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/numpy/numpy-2.0.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (19.5 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19.5/19.5 MB 294.8 MB/s eta 0:00:00
Downloading http://pypi-mirror.modal.local:5555/simple/stack-data/stack_data-0.6.3-py3-none-any.whl (24 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/anyio/anyio-4.4.0-py3-none-any.whl (86 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 86.8/86.8 kB 262.1 MB/s eta 0:00:00
Downloading http://pypi-mirror.modal.local:5555/simple/asttokens/asttokens-2.4.1-py2.py3-none-any.whl (27 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/executing/executing-2.0.1-py2.py3-none-any.whl (24 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/hpack/hpack-4.0.0-py3-none-any.whl (32 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/hyperframe/hyperframe-6.0.1-py3-none-any.whl (12 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/idna/idna-3.7-py3-none-any.whl (66 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 66.8/66.8 kB 243.7 MB/s eta 0:00:00
Downloading http://pypi-mirror.modal.local:5555/simple/jsonschema-specifications/jsonschema_specifications-2023.12.1-py3-none-any.whl (18 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/parso/parso-0.8.4-py2.py3-none-any.whl (103 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 103.7/103.7 kB 276.4 MB/s eta 0:00:00
Downloading http://pypi-mirror.modal.local:5555/simple/ptyprocess/ptyprocess-0.7.0-py2.py3-none-any.whl (13 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/referencing/referencing-0.35.1-py3-none-any.whl (26 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/rpds-py/rpds_py-0.19.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (355 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 355.6/355.6 kB 289.4 MB/s eta 0:00:00
Downloading http://pypi-mirror.modal.local:5555/simple/pure-eval/pure_eval-0.2.3-py3-none-any.whl (11 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/wcwidth/wcwidth-0.2.13-py2.py3-none-any.whl (34 kB)
Downloading http://pypi-mirror.modal.local:5555/simple/sniffio/sniffio-1.3.1-py3-none-any.whl (10 kB)
Building wheels for collected packages: aiostream, grpclib
  Building wheel for aiostream (pyproject.toml): started
  Building wheel for aiostream (pyproject.toml): finished with status 'done'
  Created wheel for aiostream: filename=aiostream-0.4.4-py3-none-any.whl size=35632 sha256=fab414a98afdc6de784fc2c1773c10dbe7a2c2e65dbb9d02a2d37957b96575db
  Stored in directory: /tmp/pip-ephem-wheel-cache-59ara946/wheels/31/cc/18/be7acccb6376b5e481e532117925230a7a5e28feff7dc27815
  Building wheel for grpclib (pyproject.toml): started
  Building wheel for grpclib (pyproject.toml): finished with status 'done'
  Created wheel for grpclib: filename=grpclib-0.4.3-py3-none-any.whl size=77057 sha256=71c9b24526fe237c7b430e0c76f2865f7a91ab5e51d86e89ea0e40e797039f4e
  Stored in directory: /tmp/pip-ephem-wheel-cache-59ara946/wheels/7e/8e/93/5493ebdc3f5b551d670189c142697dc296faeac974508118cf
Successfully built aiostream grpclib
Installing collected packages: wcwidth, types-toml, types-certifi, pure-eval, ptyprocess, commonmark, aiostream, zipp, xmltodict, typing-extensions, traitlets, toml, tenacity, tblib, sniffio, six, rpds-py, python-multipart, pygments, protobuf, prompt-toolkit, pexpect, parso, packaging, numpy, multidict, idna, hyperframe, hpack, frozenlist, executing, exceptiongroup, envier, decorator, cloudpickle, click, charset-normalizer, certifi, bytecode, attrs, async-timeout, asgiref, yarl, typer, typeguard, rich, referencing, pydantic, matplotlib-inline, jedi, importlib_metadata, h2, fastprogress, ddsketch, cattrs, asttokens, anyio, aiosignal, starlette, stack-data, jsonschema-specifications, grpclib, aiohttp, jsonschema, ipython, fastapi, ddtrace
Successfully installed aiohttp-3.8.3 aiosignal-1.3.1 aiostream-0.4.4 anyio-4.4.0 asgiref-3.5.2 asttokens-2.4.1 async-timeout-4.0.3 attrs-23.2.0 bytecode-0.15.1 cattrs-23.2.3 certifi-2024.7.4 charset-normalizer-2.1.1 click-8.1.7 cloudpickle-2.0.0 commonmark-0.9.1 ddsketch-3.0.1 ddtrace-1.5.2 decorator-5.1.1 envier-0.5.2 exceptiongroup-1.2.2 executing-2.0.1 fastapi-0.88.0 fastprogress-1.0.0 frozenlist-1.4.1 grpclib-0.4.3 h2-4.1.0 hpack-4.0.0 hyperframe-6.0.1 idna-3.7 importlib_metadata-4.8.1 ipython-8.26.0 jedi-0.19.1 jsonschema-4.23.0 jsonschema-specifications-2023.12.1 matplotlib-inline-0.1.7 multidict-6.0.5 numpy-2.0.1 packaging-24.1 parso-0.8.4 pexpect-4.9.0 prompt-toolkit-3.0.47 protobuf-5.27.2 ptyprocess-0.7.0 pure-eval-0.2.3 pydantic-1.10.17 pygments-2.18.0 python-multipart-0.0.9 referencing-0.35.1 rich-12.3.0 rpds-py-0.19.1 six-1.16.0 sniffio-1.3.1 stack-data-0.6.3 starlette-0.22.0 tblib-1.7.0 tenacity-8.5.0 toml-0.10.2 traitlets-5.14.3 typeguard-4.3.0 typer-0.6.1 types-certifi-2021.10.8.3 types-toml-0.10.4 typing-extensions-4.12.2 wcwidth-0.2.13 xmltodict-0.13.0 yarl-1.9.4 zipp-3.19.2
Saving image...
Image saved, took 4.35s

Built image im-WWDmNATDuibFyAD7mAqXe1 in 118.46s
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/usr/local/lib/python3.10/runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "/pkg/modal/_container_entrypoint.py", line 855, in <module>
    main(container_args, client)
  File "/pkg/modal/_container_entrypoint.py", line 767, in main
    metadata: Message = container_app.object_handle_metadata[object_id]
KeyError: 'im-hmf2kfuwV3nTWZPoMiK6rP'
florin-pop commented 1 month ago

I noticed that if I install the client from git: pip install git+https://github.com/modal-labs/modal-client.git then it works so it might have been solved already.

charlesfrye commented 1 month ago

Thanks for the report! Should've thanked you back when you reported it and the resolution.