search

bentoml / OpenLLM

Run any open-source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud.
https://bentoml.com
Apache License 2.0
10.13k stars 641 forks source link

feat(build): support absolute adapter path #276

Closed QLutz closed 5 months ago

QLutz commented 1 year ago

Describe the bug

Trying to build a Bento from a LLaMa 13B model with a locally stored adapter, it appears some package is missing.

To reproduce

openllm build llama --model-id huggyllama/llama-13b --adapter-id /my/local/adapter/ --debug

Logs

Usage: openllm build [OPTIONS] {chatglm|dolly-v2|falcon|flan-t5|gpt-neox|llama|mpt|opt|stablelm|starcoder|baichuan}
Try 'openllm build -h' for help.

Error: 'build_ctx' is required when '--adapter-id' is passsed.

Environment

Environment variable

BENTOML_DEBUG=''
BENTOML_QUIET=''
BENTOML_BUNDLE_LOCAL_BUILD=''
BENTOML_DO_NOT_TRACK=''
BENTOML_CONFIG=''
BENTOML_CONFIG_OPTIONS=''
BENTOML_PORT=''
BENTOML_HOST=''
BENTOML_API_WORKERS=''

System information

bentoml: 1.1.3 python: 3.10.12 platform: Linux-5.10.0-23-cloud-amd64-x86_64-with-glibc2.31 uid_gid: 1004:1005 conda: 23.7.2 in_conda_env: True

conda_packages
```yaml name: base channels: - file:///tmp/conda-pkgs - conda-forge - defaults dependencies: - _libgcc_mutex=0.1=conda_forge - _openmp_mutex=4.5=2_gnu - anyio=3.7.1=pyhd8ed1ab_0 - argon2-cffi=21.3.0=pyhd8ed1ab_0 - argon2-cffi-bindings=21.2.0=py310h5764c6d_3 - arrow=1.2.3=pyhd8ed1ab_0 - asttokens=2.2.1=pyhd8ed1ab_0 - async-lru=2.0.4=pyhd8ed1ab_0 - attrs=23.1.0=pyh71513ae_1 - babel=2.12.1=pyhd8ed1ab_1 - backcall=0.2.0=pyh9f0ad1d_0 - backports=1.0=pyhd8ed1ab_3 - backports.functools_lru_cache=1.6.5=pyhd8ed1ab_0 - beautifulsoup4=4.12.2=pyha770c72_0 - bleach=6.0.0=pyhd8ed1ab_0 - boltons=23.0.0=pyhd8ed1ab_0 - brotli-python=1.0.9=py310hd8f1fbe_9 - bzip2=1.0.8=h7f98852_4 - ca-certificates=2023.7.22=hbcca054_0 - cached-property=1.5.2=hd8ed1ab_1 - cached_property=1.5.2=pyha770c72_1 - certifi=2023.7.22=pyhd8ed1ab_0 - cffi=1.15.1=py310h255011f_3 - charset-normalizer=3.2.0=pyhd8ed1ab_0 - colorama=0.4.6=pyhd8ed1ab_0 - comm=0.1.4=pyhd8ed1ab_0 - conda=23.7.2=py310hff52083_0 - conda-package-handling=2.2.0=pyh38be061_0 - conda-package-streaming=0.9.0=pyhd8ed1ab_0 - cryptography=41.0.3=py310h75e40e8_0 - decorator=5.1.1=pyhd8ed1ab_0 - defusedxml=0.7.1=pyhd8ed1ab_0 - dlenv-base=1.0.20230807=py310_0 - entrypoints=0.4=pyhd8ed1ab_0 - exceptiongroup=1.1.2=pyhd8ed1ab_0 - executing=1.2.0=pyhd8ed1ab_0 - flit-core=3.9.0=pyhd8ed1ab_0 - fqdn=1.5.1=pyhd8ed1ab_0 - icu=72.1=hcb278e6_0 - idna=3.4=pyhd8ed1ab_0 - importlib_metadata=6.8.0=hd8ed1ab_0 - importlib_resources=6.0.1=pyhd8ed1ab_0 - ipykernel=6.25.1=pyh71e2992_0 - ipython=8.14.0=pyh41d4057_0 - isoduration=20.11.0=pyhd8ed1ab_0 - jedi=0.19.0=pyhd8ed1ab_0 - jinja2=3.1.2=pyhd8ed1ab_1 - json5=0.9.14=pyhd8ed1ab_0 - jsonpatch=1.32=pyhd8ed1ab_0 - jsonpointer=2.0=py_0 - jsonschema=4.19.0=pyhd8ed1ab_0 - jsonschema-specifications=2023.7.1=pyhd8ed1ab_0 - jsonschema-with-format-nongpl=4.19.0=pyhd8ed1ab_0 - jupyter-lsp=2.2.0=pyhd8ed1ab_0 - jupyter_client=8.3.0=pyhd8ed1ab_0 - jupyter_core=5.3.1=py310hff52083_0 - jupyter_events=0.7.0=pyhd8ed1ab_1 - jupyter_server=2.7.0=pyhd8ed1ab_0 - jupyter_server_terminals=0.4.4=pyhd8ed1ab_1 - jupyterlab_pygments=0.2.2=pyhd8ed1ab_0 - jupyterlab_server=2.24.0=pyhd8ed1ab_0 - ld_impl_linux-64=2.40=h41732ed_0 - libffi=3.4.2=h7f98852_5 - libgcc-ng=13.1.0=he5830b7_0 - libgomp=13.1.0=he5830b7_0 - libnsl=2.0.0=h7f98852_0 - libsodium=1.0.18=h36c2ea0_1 - libsqlite=3.42.0=h2797004_0 - libstdcxx-ng=13.1.0=hfd8a6a1_0 - libuuid=2.38.1=h0b41bf4_0 - libuv=1.44.2=hd590300_1 - libzlib=1.2.13=hd590300_5 - markupsafe=2.1.3=py310h2372a71_0 - matplotlib-inline=0.1.6=pyhd8ed1ab_0 - nb_conda=2.2.1=unix_6 - nb_conda_kernels=2.3.1=py310hff52083_2 - nbclient=0.8.0=pyhd8ed1ab_0 - nbconvert-core=7.7.3=pyhd8ed1ab_0 - nbformat=5.9.2=pyhd8ed1ab_0 - ncurses=6.4=hcb278e6_0 - nodejs=18.16.1=hf52ce11_0 - notebook-shim=0.2.3=pyhd8ed1ab_0 - openssl=3.1.2=hd590300_0 - overrides=7.4.0=pyhd8ed1ab_0 - packaging=23.1=pyhd8ed1ab_0 - pandocfilters=1.5.0=pyhd8ed1ab_0 - parso=0.8.3=pyhd8ed1ab_0 - pexpect=4.8.0=pyh1a96a4e_2 - pickleshare=0.7.5=py_1003 - pip=23.2.1=pyhd8ed1ab_0 - pkgutil-resolve-name=1.3.10=pyhd8ed1ab_0 - platformdirs=3.10.0=pyhd8ed1ab_0 - pluggy=1.2.0=pyhd8ed1ab_0 - prometheus_client=0.17.1=pyhd8ed1ab_0 - prompt-toolkit=3.0.39=pyha770c72_0 - prompt_toolkit=3.0.39=hd8ed1ab_0 - ptyprocess=0.7.0=pyhd3deb0d_0 - pure_eval=0.2.2=pyhd8ed1ab_0 - pycosat=0.6.4=py310h5764c6d_1 - pycparser=2.21=pyhd8ed1ab_0 - pygments=2.16.1=pyhd8ed1ab_0 - pyopenssl=23.2.0=pyhd8ed1ab_1 - pysocks=1.7.1=pyha2e5f31_6 - python=3.10.12=hd12c33a_0_cpython - python-dateutil=2.8.2=pyhd8ed1ab_0 - python-fastjsonschema=2.18.0=pyhd8ed1ab_0 - python-json-logger=2.0.7=pyhd8ed1ab_0 - python_abi=3.10=3_cp310 - pytz=2023.3=pyhd8ed1ab_0 - readline=8.2=h8228510_1 - referencing=0.30.2=pyhd8ed1ab_0 - requests=2.31.0=pyhd8ed1ab_0 - rfc3339-validator=0.1.4=pyhd8ed1ab_0 - rfc3986-validator=0.1.1=pyh9f0ad1d_0 - rpds-py=0.9.2=py310hcb5633a_0 - ruamel.yaml=0.17.32=py310h2372a71_0 - ruamel.yaml.clib=0.2.7=py310h1fa729e_1 - send2trash=1.8.2=pyh41d4057_0 - setuptools=68.0.0=pyhd8ed1ab_0 - six=1.16.0=pyh6c4a22f_0 - sniffio=1.3.0=pyhd8ed1ab_0 - stack_data=0.6.2=pyhd8ed1ab_0 - terminado=0.17.1=pyh41d4057_0 - tinycss2=1.2.1=pyhd8ed1ab_0 - tk=8.6.12=h27826a3_0 - tomli=2.0.1=pyhd8ed1ab_0 - toolz=0.12.0=pyhd8ed1ab_0 - tornado=6.3.2=py310h2372a71_0 - tqdm=4.65.0=pyhd8ed1ab_1 - traitlets=5.9.0=pyhd8ed1ab_0 - typing-extensions=4.7.1=hd8ed1ab_0 - typing_extensions=4.7.1=pyha770c72_0 - typing_utils=0.1.0=pyhd8ed1ab_0 - uri-template=1.3.0=pyhd8ed1ab_0 - wcwidth=0.2.6=pyhd8ed1ab_0 - webcolors=1.13=pyhd8ed1ab_0 - websocket-client=1.6.1=pyhd8ed1ab_0 - wheel=0.41.1=pyhd8ed1ab_0 - xz=5.2.6=h166bdaf_0 - yaml=0.2.5=h7f98852_2 - zeromq=4.3.4=h9c3ff4c_1 - zipp=3.16.2=pyhd8ed1ab_0 - zlib=1.2.13=hd590300_5 - zstandard=0.19.0=py310h1275a96_2 - zstd=1.5.2=hfc55251_7 - pip: - absl-py==1.4.0 - accelerate==0.22.0 - aiohttp==3.8.5 - aiohttp-cors==0.7.0 - aiorwlock==1.3.0 - aiosignal==1.3.1 - ansiwrap==0.8.4 - appdirs==1.4.4 - asgiref==3.7.2 - async-timeout==4.0.2 - backoff==2.2.1 - beatrix-jupyterlab==2023.84.194007 - bentoml==1.1.3 - bitsandbytes==0.41.1 - blessed==1.20.0 - build==0.10.0 - cachetools==5.3.1 - cattrs==23.1.2 - circus==0.18.0 - click==8.1.6 - click-option-group==0.5.6 - cloud-tpu-client==0.10 - cloudpickle==2.2.1 - cmake==3.27.2 - coloredlogs==15.0.1 - colorful==0.5.5 - contextlib2==21.6.0 - contourpy==1.1.0 - cuda-python==12.2.0 - cycler==0.11.0 - cython==3.0.0 - dacite==1.8.1 - datasets==2.14.4 - db-dtypes==1.1.1 - debugpy==1.6.7 - deepmerge==1.1.0 - deprecated==1.2.14 - dill==0.3.7 - distlib==0.3.7 - dm-tree==0.1.8 - docker==6.1.3 - docstring-parser==0.15 - fairscale==0.4.13 - fastapi==0.101.0 - fastcore==1.5.29 - filelock==3.12.2 - filetype==1.2.0 - fonttools==4.42.0 - frozenlist==1.4.0 - fs==2.4.16 - fsspec==2023.6.0 - gcsfs==2023.6.0 - ghapi==1.0.4 - gitdb==4.0.10 - gitpython==3.1.32 - google-api-core==1.34.0 - google-api-python-client==1.8.0 - google-auth==2.22.0 - google-auth-httplib2==0.1.0 - google-auth-oauthlib==1.0.0 - google-cloud-aiplatform==1.29.0 - google-cloud-artifact-registry==1.8.3 - google-cloud-bigquery==3.11.4 - google-cloud-bigquery-storage==2.22.0 - google-cloud-core==2.3.3 - google-cloud-datastore==1.15.5 - google-cloud-language==2.10.1 - google-cloud-monitoring==2.15.1 - google-cloud-resource-manager==1.10.3 - google-cloud-storage==2.10.0 - google-crc32c==1.5.0 - google-resumable-media==2.5.0 - googleapis-common-protos==1.60.0 - gpustat==1.0.0 - greenlet==2.0.2 - grpc-google-iam-v1==0.12.6 - grpcio==1.56.2 - grpcio-status==1.48.2 - gymnasium==0.26.3 - gymnasium-notices==0.0.1 - h11==0.14.0 - htmlmin==0.1.12 - httpcore==0.17.3 - httplib2==0.22.0 - httpx==0.24.1 - huggingface-hub==0.16.4 - humanfriendly==10.0 - imagehash==4.3.1 - imageio==2.31.1 - importlib-metadata==6.0.1 - inflection==0.5.1 - ipython-genutils==0.2.0 - ipython-sql==0.5.0 - ipywidgets==8.1.0 - jaraco-classes==3.3.0 - jeepney==0.8.0 - joblib==1.3.1 - jupyter-client==7.4.9 - jupyter-http-over-ws==0.0.8 - jupyter-server==1.24.0 - jupyter-server-mathjax==0.2.6 - jupyter-server-proxy==4.0.0 - jupyterlab==3.4.8 - jupyterlab-git==0.41.0 - jupyterlab-widgets==3.0.8 - jupytext==1.15.0 - keyring==24.2.0 - keyrings-google-artifactregistry-auth==1.1.2 - kfp==2.0.1 - kfp-pipeline-spec==0.2.2 - kfp-server-api==2.0.0 - kiwisolver==1.4.4 - kubernetes==26.1.0 - lazy-loader==0.3 - lit==16.0.6 - llvmlite==0.40.1 - lz4==4.3.2 - markdown-it-py==3.0.0 - matplotlib==3.7.2 - mdit-py-plugins==0.4.0 - mdurl==0.1.2 - mistune==3.0.1 - more-itertools==10.1.0 - mpmath==1.3.0 - msgpack==1.0.5 - multidict==6.0.4 - multimethod==1.9.1 - multiprocess==0.70.15 - mypy-extensions==1.0.0 - nbclassic==1.0.0 - nbdime==3.2.0 - nest-asyncio==1.5.7 - networkx==3.1 - ninja==1.11.1 - notebook==6.5.5 - notebook-executor==0.2 - numba==0.57.1 - numpy==1.23.5 - nvidia-cublas-cu11==11.10.3.66 - nvidia-cuda-cupti-cu11==11.7.101 - nvidia-cuda-nvrtc-cu11==11.7.99 - nvidia-cuda-runtime-cu11==11.7.99 - nvidia-cudnn-cu11==8.5.0.96 - nvidia-cufft-cu11==10.9.0.58 - nvidia-curand-cu11==10.2.10.91 - nvidia-cusolver-cu11==11.4.0.1 - nvidia-cusparse-cu11==11.7.4.91 - nvidia-ml-py==11.495.46 - nvidia-nccl-cu11==2.14.3 - nvidia-nvtx-cu11==11.7.91 - oauth2client==4.1.3 - oauthlib==3.2.2 - opencensus==0.11.2 - opencensus-context==0.1.3 - openllm==0.2.27 - openllm-client==0.2.27 - openllm-core==0.2.27 - opentelemetry-api==1.18.0 - opentelemetry-exporter-otlp==1.19.0 - opentelemetry-exporter-otlp-proto-common==1.19.0 - opentelemetry-exporter-otlp-proto-grpc==1.19.0 - opentelemetry-exporter-otlp-proto-http==1.19.0 - opentelemetry-instrumentation==0.39b0 - opentelemetry-instrumentation-aiohttp-client==0.39b0 - opentelemetry-instrumentation-asgi==0.39b0 - opentelemetry-proto==1.19.0 - opentelemetry-sdk==1.18.0 - opentelemetry-semantic-conventions==0.39b0 - opentelemetry-util-http==0.39b0 - optimum==1.12.0 - orjson==3.9.5 - pandas==2.0.3 - pandas-profiling==3.6.6 - papermill==2.4.0 - pathspec==0.11.2 - patsy==0.5.3 - peft==0.5.0 - phik==0.12.3 - pillow==10.0.0 - pip-requirements-parser==32.0.1 - pip-tools==7.3.0 - plotly==5.15.0 - prettytable==3.8.0 - proto-plus==1.22.3 - protobuf==3.20.3 - psutil==5.9.3 - py-spy==0.3.14 - pyarrow==12.0.1 - pyasn1==0.5.0 - pyasn1-modules==0.3.0 - pydantic==1.10.12 - pyjwt==2.8.0 - pynvml==11.5.0 - pyparsing==3.0.9 - pyproject-hooks==1.0.0 - python-multipart==0.0.6 - pywavelets==1.4.1 - pyyaml==6.0.1 - pyzmq==24.0.1 - ray==2.6.2 - ray-cpp==2.6.2 - regex==2023.8.8 - requests-oauthlib==1.3.1 - requests-toolbelt==0.10.1 - retrying==1.3.4 - rich==13.5.2 - safetensors==0.3.3 - schema==0.7.5 - scikit-image==0.21.0 - scikit-learn==1.3.0 - scipy==1.11.1 - seaborn==0.12.2 - secretstorage==3.3.3 - sentencepiece==0.1.99 - shapely==1.8.5.post1 - simpervisor==1.0.0 - simple-di==0.1.5 - smart-open==6.3.0 - smmap==5.0.0 - soupsieve==2.4.1 - sqlalchemy==2.0.19 - sqlparse==0.4.4 - starlette==0.27.0 - statsmodels==0.14.0 - sympy==1.12 - tabulate==0.9.0 - tangled-up-in-unicode==0.2.0 - tenacity==8.2.2 - tensorboardx==2.6.2 - textwrap3==0.9.2 - threadpoolctl==3.2.0 - tifffile==2023.7.18 - tokenizers==0.13.3 - toml==0.10.2 - torch==2.0.1 - transformers==4.32.1 - triton==2.0.0 - trl==0.6.0 - typeguard==2.13.3 - typer==0.9.0 - tzdata==2023.3 - uritemplate==3.0.1 - urllib3==1.26.16 - uvicorn==0.23.2 - virtualenv==20.21.0 - visions==0.7.5 - vllm==0.1.4 - watchfiles==0.20.0 - webencodings==0.5.1 - widgetsnbextension==4.0.8 - wordcloud==1.9.2 - wrapt==1.15.0 - xformers==0.0.21 - xxhash==3.3.0 - yarl==1.9.2 - ydata-profiling==4.4.0 prefix: /opt/conda ```
pip_packages
``` absl-py==1.4.0 accelerate==0.22.0 aiohttp==3.8.5 aiohttp-cors==0.7.0 aiorwlock==1.3.0 aiosignal==1.3.1 ansiwrap==0.8.4 anyio @ file:///home/conda/feedstock_root/build_artifacts/anyio_1688651106312/work/dist appdirs==1.4.4 argon2-cffi @ file:///home/conda/feedstock_root/build_artifacts/argon2-cffi_1640817743617/work argon2-cffi-bindings @ file:///home/conda/feedstock_root/build_artifacts/argon2-cffi-bindings_1666850768662/work arrow @ file:///home/conda/feedstock_root/build_artifacts/arrow_1662382474514/work asgiref==3.7.2 asttokens @ file:///home/conda/feedstock_root/build_artifacts/asttokens_1670263926556/work async-lru @ file:///home/conda/feedstock_root/build_artifacts/async-lru_1690563019058/work async-timeout==4.0.2 attrs @ file:///home/conda/feedstock_root/build_artifacts/attrs_1683424013410/work Babel @ file:///home/conda/feedstock_root/build_artifacts/babel_1677767029043/work backcall @ file:///home/conda/feedstock_root/build_artifacts/backcall_1592338393461/work backoff==2.2.1 backports.functools-lru-cache @ file:///home/conda/feedstock_root/build_artifacts/backports.functools_lru_cache_1687772187254/work beatrix-jupyterlab @ file:///home/kbuilder/miniconda3/conda-bld/dlenv-base_1691445212683/work/packages/beatrix_jupyterlab-2023.84.194007.tar.gz#sha256=304855d9bdf0eb76ca0184e14d438c0d3d4360e3e56a2be5874849677cc8dece beautifulsoup4 @ file:///home/conda/feedstock_root/build_artifacts/beautifulsoup4_1680888073205/work bentoml==1.1.3 bitsandbytes==0.41.1 bleach @ file:///home/conda/feedstock_root/build_artifacts/bleach_1674535352125/work blessed==1.20.0 boltons @ file:///home/conda/feedstock_root/build_artifacts/boltons_1677499911949/work Brotli @ file:///home/conda/feedstock_root/build_artifacts/brotli-split_1687884021435/work build==0.10.0 cached-property @ file:///home/conda/feedstock_root/build_artifacts/cached_property_1615209429212/work cachetools==5.3.1 cattrs==23.1.2 certifi==2023.7.22 cffi @ file:///home/conda/feedstock_root/build_artifacts/cffi_1671179353105/work charset-normalizer @ file:///home/conda/feedstock_root/build_artifacts/charset-normalizer_1688813409104/work circus==0.18.0 click==8.1.6 click-option-group==0.5.6 cloud-tpu-client==0.10 cloudpickle==2.2.1 cmake==3.27.2 colorama @ file:///home/conda/feedstock_root/build_artifacts/colorama_1666700638685/work coloredlogs==15.0.1 colorful==0.5.5 comm @ file:///home/conda/feedstock_root/build_artifacts/comm_1691044910542/work conda @ file:///home/conda/feedstock_root/build_artifacts/conda_1690552914978/work conda-package-handling @ file:///home/conda/feedstock_root/build_artifacts/conda-package-handling_1691048088238/work conda_package_streaming @ file:///home/conda/feedstock_root/build_artifacts/conda-package-streaming_1691009212940/work contextlib2==21.6.0 contourpy==1.1.0 cryptography @ file:///home/conda/feedstock_root/build_artifacts/cryptography-split_1691444160254/work cuda-python==12.2.0 cycler==0.11.0 Cython==3.0.0 dacite==1.8.1 datasets==2.14.4 db-dtypes==1.1.1 debugpy==1.6.7 decorator @ file:///home/conda/feedstock_root/build_artifacts/decorator_1641555617451/work deepmerge==1.1.0 defusedxml @ file:///home/conda/feedstock_root/build_artifacts/defusedxml_1615232257335/work Deprecated==1.2.14 dill==0.3.7 distlib==0.3.7 dm-tree==0.1.8 docker==6.1.3 docstring-parser==0.15 entrypoints @ file:///home/conda/feedstock_root/build_artifacts/entrypoints_1643888246732/work exceptiongroup @ file:///home/conda/feedstock_root/build_artifacts/exceptiongroup_1688381075899/work executing @ file:///home/conda/feedstock_root/build_artifacts/executing_1667317341051/work fairscale==0.4.13 fastapi==0.101.0 fastcore==1.5.29 fastjsonschema @ file:///home/conda/feedstock_root/build_artifacts/python-fastjsonschema_1690055433477/work/dist filelock==3.12.2 filetype==1.2.0 flit_core @ file:///home/conda/feedstock_root/build_artifacts/flit-core_1684084314667/work/source/flit_core fonttools==4.42.0 fqdn @ file:///home/conda/feedstock_root/build_artifacts/fqdn_1638810296540/work/dist frozenlist==1.4.0 fs==2.4.16 fsspec==2023.6.0 gcsfs==2023.6.0 ghapi==1.0.4 gitdb==4.0.10 GitPython==3.1.32 google-api-core==1.34.0 google-api-python-client==1.8.0 google-auth==2.22.0 google-auth-httplib2==0.1.0 google-auth-oauthlib==1.0.0 google-cloud-aiplatform==1.29.0 google-cloud-artifact-registry==1.8.3 google-cloud-bigquery==3.11.4 google-cloud-bigquery-storage==2.22.0 google-cloud-core==2.3.3 google-cloud-datastore==1.15.5 google-cloud-language==2.10.1 google-cloud-monitoring==2.15.1 google-cloud-resource-manager==1.10.3 google-cloud-storage==2.10.0 google-crc32c==1.5.0 google-resumable-media==2.5.0 googleapis-common-protos==1.60.0 gpustat==1.0.0 greenlet==2.0.2 grpc-google-iam-v1==0.12.6 grpcio==1.56.2 grpcio-status==1.48.2 Gymnasium==0.26.3 gymnasium-notices==0.0.1 h11==0.14.0 htmlmin==0.1.12 httpcore==0.17.3 httplib2==0.22.0 httpx==0.24.1 huggingface-hub==0.16.4 humanfriendly==10.0 idna @ file:///home/conda/feedstock_root/build_artifacts/idna_1663625384323/work ImageHash==4.3.1 imageio==2.31.1 importlib-metadata==6.0.1 importlib-resources @ file:///home/conda/feedstock_root/build_artifacts/importlib_resources_1691408075105/work inflection==0.5.1 ipykernel @ file:///home/conda/feedstock_root/build_artifacts/ipykernel_1691424382338/work ipython @ file:///home/conda/feedstock_root/build_artifacts/ipython_1685727741709/work ipython-genutils==0.2.0 ipython-sql==0.5.0 ipywidgets==8.1.0 isoduration @ file:///home/conda/feedstock_root/build_artifacts/isoduration_1638811571363/work/dist jaraco.classes==3.3.0 jedi @ file:///home/conda/feedstock_root/build_artifacts/jedi_1690896916983/work jeepney==0.8.0 Jinja2 @ file:///home/conda/feedstock_root/build_artifacts/jinja2_1654302431367/work joblib==1.3.1 json5 @ file:///home/conda/feedstock_root/build_artifacts/json5_1688248289187/work jsonpatch @ file:///home/conda/feedstock_root/build_artifacts/jsonpatch_1632759296524/work jsonpointer==2.0 jsonschema @ file:///home/conda/feedstock_root/build_artifacts/jsonschema-meta_1691407964752/work jsonschema-specifications @ file:///home/conda/feedstock_root/build_artifacts/jsonschema-specifications_1689701150890/work jupyter-events @ file:///home/conda/feedstock_root/build_artifacts/jupyter_events_1691022782867/work jupyter-http-over-ws==0.0.8 jupyter-lsp @ file:///home/conda/feedstock_root/build_artifacts/jupyter-lsp-meta_1685453365113/work/jupyter-lsp jupyter-server==1.24.0 jupyter-server-mathjax==0.2.6 jupyter_client==7.4.9 jupyter_core @ file:///home/conda/feedstock_root/build_artifacts/jupyter_core_1686775611663/work jupyter_server_proxy==4.0.0 jupyter_server_terminals @ file:///home/conda/feedstock_root/build_artifacts/jupyter_server_terminals_1673491454549/work jupyterlab==3.4.8 jupyterlab-git==0.41.0 jupyterlab-pygments @ file:///home/conda/feedstock_root/build_artifacts/jupyterlab_pygments_1649936611996/work jupyterlab-widgets==3.0.8 jupyterlab_server @ file:///home/conda/feedstock_root/build_artifacts/jupyterlab_server_1690205927615/work jupytext==1.15.0 keyring==24.2.0 keyrings.google-artifactregistry-auth==1.1.2 kfp==2.0.1 kfp-pipeline-spec==0.2.2 kfp-server-api==2.0.0 kiwisolver==1.4.4 kubernetes==26.1.0 lazy_loader==0.3 lit==16.0.6 llvmlite==0.40.1 lz4==4.3.2 markdown-it-py==3.0.0 MarkupSafe @ file:///home/conda/feedstock_root/build_artifacts/markupsafe_1685769049201/work matplotlib==3.7.2 matplotlib-inline @ file:///home/conda/feedstock_root/build_artifacts/matplotlib-inline_1660814786464/work mdit-py-plugins==0.4.0 mdurl==0.1.2 mistune @ file:///home/conda/feedstock_root/build_artifacts/mistune_1686313613819/work/dist more-itertools==10.1.0 mpmath==1.3.0 msgpack==1.0.5 multidict==6.0.4 multimethod==1.9.1 multiprocess==0.70.15 mypy-extensions==1.0.0 nb-conda @ file:///home/conda/feedstock_root/build_artifacts/nb_conda_1654442778977/work nb-conda-kernels @ file:///home/conda/feedstock_root/build_artifacts/nb_conda_kernels_1667060632461/work nbclassic==1.0.0 nbclient @ file:///home/conda/feedstock_root/build_artifacts/nbclient_1684790896106/work nbconvert @ file:///home/conda/feedstock_root/build_artifacts/nbconvert-meta_1690313290323/work nbdime==3.2.0 nbformat @ file:///home/conda/feedstock_root/build_artifacts/nbformat_1690814868471/work nest-asyncio @ file:///home/conda/feedstock_root/build_artifacts/nest-asyncio_1664684991461/work networkx==3.1 ninja==1.11.1 notebook==6.5.5 notebook-executor @ file:///home/kbuilder/miniconda3/conda-bld/dlenv-base_1691445212683/work/packages/notebook_executor notebook_shim @ file:///home/conda/feedstock_root/build_artifacts/notebook-shim_1682360583588/work numba==0.57.1 numpy==1.23.5 nvidia-cublas-cu11==11.10.3.66 nvidia-cuda-cupti-cu11==11.7.101 nvidia-cuda-nvrtc-cu11==11.7.99 nvidia-cuda-runtime-cu11==11.7.99 nvidia-cudnn-cu11==8.5.0.96 nvidia-cufft-cu11==10.9.0.58 nvidia-curand-cu11==10.2.10.91 nvidia-cusolver-cu11==11.4.0.1 nvidia-cusparse-cu11==11.7.4.91 nvidia-ml-py==11.495.46 nvidia-nccl-cu11==2.14.3 nvidia-nvtx-cu11==11.7.91 oauth2client==4.1.3 oauthlib==3.2.2 opencensus==0.11.2 opencensus-context==0.1.3 openllm==0.2.27 openllm-client==0.2.27 openllm-core==0.2.27 opentelemetry-api==1.18.0 opentelemetry-exporter-otlp==1.19.0 opentelemetry-exporter-otlp-proto-common==1.19.0 opentelemetry-exporter-otlp-proto-grpc==1.19.0 opentelemetry-exporter-otlp-proto-http==1.19.0 opentelemetry-instrumentation==0.39b0 opentelemetry-instrumentation-aiohttp-client==0.39b0 opentelemetry-instrumentation-asgi==0.39b0 opentelemetry-proto==1.19.0 opentelemetry-sdk==1.18.0 opentelemetry-semantic-conventions==0.39b0 opentelemetry-util-http==0.39b0 optimum==1.12.0 orjson==3.9.5 overrides @ file:///home/conda/feedstock_root/build_artifacts/overrides_1691338815398/work packaging @ file:///home/conda/feedstock_root/build_artifacts/packaging_1681337016113/work pandas==2.0.3 pandas-profiling==3.6.6 pandocfilters @ file:///home/conda/feedstock_root/build_artifacts/pandocfilters_1631603243851/work papermill==2.4.0 parso @ file:///home/conda/feedstock_root/build_artifacts/parso_1638334955874/work pathspec==0.11.2 patsy==0.5.3 peft==0.5.0 pexpect @ file:///home/conda/feedstock_root/build_artifacts/pexpect_1667297516076/work phik==0.12.3 pickleshare @ file:///home/conda/feedstock_root/build_artifacts/pickleshare_1602536217715/work Pillow==10.0.0 pip-requirements-parser==32.0.1 pip-tools==7.3.0 pkgutil_resolve_name @ file:///home/conda/feedstock_root/build_artifacts/pkgutil-resolve-name_1633981968097/work platformdirs @ file:///home/conda/feedstock_root/build_artifacts/platformdirs_1690813113769/work plotly==5.15.0 pluggy @ file:///home/conda/feedstock_root/build_artifacts/pluggy_1687776318736/work prettytable==3.8.0 prometheus-client @ file:///home/conda/feedstock_root/build_artifacts/prometheus_client_1689032443210/work prompt-toolkit @ file:///home/conda/feedstock_root/build_artifacts/prompt-toolkit_1688565951714/work proto-plus==1.22.3 protobuf==3.20.3 psutil==5.9.3 ptyprocess @ file:///home/conda/feedstock_root/build_artifacts/ptyprocess_1609419310487/work/dist/ptyprocess-0.7.0-py2.py3-none-any.whl pure-eval @ file:///home/conda/feedstock_root/build_artifacts/pure_eval_1642875951954/work py-spy==0.3.14 pyarrow==12.0.1 pyasn1==0.5.0 pyasn1-modules==0.3.0 pycosat @ file:///home/conda/feedstock_root/build_artifacts/pycosat_1666836542287/work pycparser @ file:///home/conda/feedstock_root/build_artifacts/pycparser_1636257122734/work pydantic==1.10.12 Pygments @ file:///home/conda/feedstock_root/build_artifacts/pygments_1691408637400/work PyJWT==2.8.0 pynvml==11.5.0 pyOpenSSL @ file:///home/conda/feedstock_root/build_artifacts/pyopenssl_1685514481738/work pyparsing==3.0.9 pyproject_hooks==1.0.0 PySocks @ file:///home/conda/feedstock_root/build_artifacts/pysocks_1661604839144/work python-dateutil @ file:///home/conda/feedstock_root/build_artifacts/python-dateutil_1626286286081/work python-json-logger @ file:///home/conda/feedstock_root/build_artifacts/python-json-logger_1677079630776/work python-multipart==0.0.6 pytz @ file:///home/conda/feedstock_root/build_artifacts/pytz_1680088766131/work PyWavelets==1.4.1 PyYAML==6.0.1 pyzmq==24.0.1 ray==2.6.2 ray-cpp==2.6.2 referencing @ file:///home/conda/feedstock_root/build_artifacts/referencing_1691337268233/work regex==2023.8.8 requests @ file:///home/conda/feedstock_root/build_artifacts/requests_1684774241324/work requests-oauthlib==1.3.1 requests-toolbelt==0.10.1 retrying==1.3.4 rfc3339-validator @ file:///home/conda/feedstock_root/build_artifacts/rfc3339-validator_1638811747357/work rfc3986-validator @ file:///home/conda/feedstock_root/build_artifacts/rfc3986-validator_1598024191506/work rich==13.5.2 rpds-py @ file:///home/conda/feedstock_root/build_artifacts/rpds-py_1689705060450/work rsa==4.9 ruamel.yaml @ file:///home/conda/feedstock_root/build_artifacts/ruamel.yaml_1686993901728/work ruamel.yaml.clib @ file:///home/conda/feedstock_root/build_artifacts/ruamel.yaml.clib_1670412719074/work safetensors==0.3.3 schema==0.7.5 scikit-image==0.21.0 scikit-learn==1.3.0 scipy==1.11.1 seaborn==0.12.2 SecretStorage==3.3.3 Send2Trash @ file:///home/conda/feedstock_root/build_artifacts/send2trash_1682601222253/work sentencepiece==0.1.99 Shapely==1.8.5.post1 simpervisor==1.0.0 simple-di==0.1.5 six @ file:///home/conda/feedstock_root/build_artifacts/six_1620240208055/work smart-open==6.3.0 smmap==5.0.0 sniffio @ file:///home/conda/feedstock_root/build_artifacts/sniffio_1662051266223/work soupsieve @ file:///home/conda/feedstock_root/build_artifacts/soupsieve_1658207591808/work SQLAlchemy==2.0.19 sqlparse==0.4.4 stack-data @ file:///home/conda/feedstock_root/build_artifacts/stack_data_1669632077133/work starlette==0.27.0 statsmodels==0.14.0 sympy==1.12 tabulate==0.9.0 tangled-up-in-unicode==0.2.0 tenacity==8.2.2 tensorboardX==2.6.2 terminado @ file:///home/conda/feedstock_root/build_artifacts/terminado_1670253674810/work textwrap3==0.9.2 threadpoolctl==3.2.0 tifffile==2023.7.18 tinycss2 @ file:///home/conda/feedstock_root/build_artifacts/tinycss2_1666100256010/work tokenizers==0.13.3 toml==0.10.2 tomli @ file:///home/conda/feedstock_root/build_artifacts/tomli_1644342247877/work toolz @ file:///home/conda/feedstock_root/build_artifacts/toolz_1657485559105/work torch==2.0.1 tornado @ file:///home/conda/feedstock_root/build_artifacts/tornado_1684150054582/work tqdm @ file:///home/conda/feedstock_root/build_artifacts/tqdm_1677948868469/work traitlets @ file:///home/conda/feedstock_root/build_artifacts/traitlets_1675110562325/work transformers==4.32.1 triton==2.0.0 trl==0.6.0 typeguard==2.13.3 typer==0.9.0 typing-utils @ file:///home/conda/feedstock_root/build_artifacts/typing_utils_1622899189314/work typing_extensions @ file:///home/conda/feedstock_root/build_artifacts/typing_extensions_1688315532570/work tzdata==2023.3 uri-template @ file:///home/conda/feedstock_root/build_artifacts/uri-template_1688655812972/work/dist uritemplate==3.0.1 urllib3==1.26.16 uvicorn==0.23.2 virtualenv==20.21.0 visions==0.7.5 vllm==0.1.4 watchfiles==0.20.0 wcwidth @ file:///home/conda/feedstock_root/build_artifacts/wcwidth_1673864653149/work webcolors @ file:///home/conda/feedstock_root/build_artifacts/webcolors_1679900785843/work webencodings==0.5.1 websocket-client @ file:///home/conda/feedstock_root/build_artifacts/websocket-client_1687789148259/work widgetsnbextension==4.0.8 wordcloud==1.9.2 wrapt==1.15.0 xformers==0.0.21 xxhash==3.3.0 yarl==1.9.2 ydata-profiling==4.4.0 zipp @ file:///home/conda/feedstock_root/build_artifacts/zipp_1689374466814/work zstandard==0.19.0 ```

System information (Optional)

a2-highgpu-1g from GCP with 1xA100 80GB

aarnphm commented 1 year ago

This is not a bug. We need to know what the build context is in order to copy the adapter correctly.

Relative path is actually very hard to do !

Not a bug. Closing for irrelevance.

QLutz commented 1 year ago

What is the appropriate way to do it then?

aarnphm commented 1 year ago

You will need to pass in `--build-context to the path of the build context.

Now thinking more about it, I will reopen this and probably what openllm can do is that we can support absolute path.