search

corca-ai / EVAL

EVAL(Elastic Versatile Agent with Langchain) will execute all your requests. Just like an eval method!
MIT License
869 stars 82 forks source link

Running on M1 ARM Macs #13

Closed ChristianWeyer closed 1 year ago

ChristianWeyer commented 1 year ago

Great project! 💥

Do you think this should run on an M1 MBP? I am running into this error in docker compose up -d:

 => ERROR [eval.gpu 11/12] RUN poetry install --with tools,gpu                                                                                                                      18.9s
------
 > [eval.gpu 11/12] RUN poetry install --with tools,gpu:
#0 0.627 Installing dependencies from lock file
#0 0.907 
#0 0.907 Package operations: 75 installs, 0 updates, 0 removals
#0 0.907 
#0 0.908   • Installing packaging (23.0)
#0 1.148   • Installing frozenlist (1.3.3)
#0 1.148   • Installing idna (3.4)
#0 1.150   • Installing marshmallow (3.19.0)
#0 1.150   • Installing multidict (6.0.4)
#0 1.151   • Installing mypy-extensions (1.0.0)
#0 1.153   • Installing six (1.16.0)
#0 1.154   • Installing typing-extensions (4.5.0)
#0 1.316   • Installing aiosignal (1.3.1)
#0 1.316   • Installing async-timeout (4.0.2)
#0 1.317   • Installing attrs (22.2.0)
#0 1.317   • Installing certifi (2022.12.7)
#0 1.318   • Installing charset-normalizer (3.1.0)
#0 1.321   • Installing greenlet (2.0.2)
#0 1.322   • Installing jmespath (1.0.1)
#0 1.323   • Installing marshmallow-enum (1.5.1)
#0 1.324   • Installing markupsafe (2.1.2)
#0 1.414   • Installing mpmath (1.3.0)
#0 1.426   • Installing python-dateutil (2.8.2)
#0 1.442   • Installing sniffio (1.3.0)
#0 1.482   • Installing typing-inspect (0.8.0)
#0 1.506   • Installing urllib3 (1.26.15)
#0 1.512   • Installing yarl (1.8.2)
#0 1.688   • Installing aiohttp (3.8.4)
#0 1.689   • Installing anyio (3.6.2)
#0 1.690   • Installing dataclasses-json (0.5.7)
#0 1.691   • Installing botocore (1.29.104)
#0 1.692   • Installing networkx (3.0)
#0 1.692   • Installing filelock (3.10.7)
#0 1.693   • Installing jinja2 (3.1.2)
#0 1.694   • Installing numpy (1.24.2)
#0 1.695   • Installing pydantic (1.10.7)
#0 1.771   • Installing pytz (2023.3)
#0 1.783   • Installing pyyaml (6.0)
#0 1.789   • Installing regex (2023.3.23)
#0 2.143   • Installing requests (2.28.2)
#0 2.170   • Installing soupsieve (2.4)
#0 2.281   • Installing sqlalchemy (1.4.47)
#0 2.282   • Installing sympy (1.11.1)
#0 2.301   • Installing tenacity (8.2.2)
#0 2.328   • Installing tqdm (4.65.0)
#0 2.385   • Installing zipp (3.15.0)
#0 5.950   • Installing beautifulsoup4 (4.12.0)
#0 5.950   • Installing click (8.1.3)
#0 5.951   • Installing h11 (0.14.0)
#0 5.952   • Installing huggingface-hub (0.13.3)
#0 5.953   • Installing langchain (0.0.115)
#0 5.954   • Installing openai (0.27.2)
#0 5.954   • Installing importlib-metadata (6.1.0)
#0 5.956   • Installing pathspec (0.11.1)
#0 5.956   • Installing pandas (1.5.3)
#0 6.047   • Installing pillow (9.5.0)
#0 6.058   • Installing platformdirs (3.2.0)
#0 6.093   • Installing psutil (5.9.4)
#0 6.115   • Installing s3transfer (0.6.0)
#0 6.169   • Installing starlette (0.26.1)
#0 6.173   • Installing tiktoken (0.3.3)
#0 6.234   • Installing tokenizers (0.13.2)
#0 6.335   • Installing tomli (2.0.1)
#0 6.376   • Installing torch (2.0.0)
#0 8.677 
#0 8.677   ChefBuildError
#0 8.677 
#0 8.677   Backend subprocess exited when trying to invoke build_wheel
#0 8.677   
#0 8.677   running bdist_wheel
#0 8.677   running build
#0 8.677   running build_py
#0 8.677   creating build
#0 8.677   creating build/lib.linux-aarch64-cpython-310
#0 8.677   creating build/lib.linux-aarch64-cpython-310/psutil
#0 8.677   copying psutil/_pswindows.py -> build/lib.linux-aarch64-cpython-310/psutil
#0 8.677   copying psutil/_psaix.py -> build/lib.linux-aarch64-cpython-310/psutil
#0 8.677   copying psutil/_psbsd.py -> build/lib.linux-aarch64-cpython-310/psutil
#0 8.677   copying psutil/_common.py -> build/lib.linux-aarch64-cpython-310/psutil
#0 8.677   copying psutil/_compat.py -> build/lib.linux-aarch64-cpython-310/psutil
#0 8.677   copying psutil/_psosx.py -> build/lib.linux-aarch64-cpython-310/psutil
#0 8.677   copying psutil/_psposix.py -> build/lib.linux-aarch64-cpython-310/psutil
#0 8.677   copying psutil/_pssunos.py -> build/lib.linux-aarch64-cpython-310/psutil
#0 8.677   copying psutil/__init__.py -> build/lib.linux-aarch64-cpython-310/psutil
#0 8.677   copying psutil/_pslinux.py -> build/lib.linux-aarch64-cpython-310/psutil
#0 8.677   creating build/lib.linux-aarch64-cpython-310/psutil/tests
#0 8.677   copying psutil/tests/test_connections.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
#0 8.677   copying psutil/tests/test_bsd.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
#0 8.677   copying psutil/tests/__main__.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
#0 8.677   copying psutil/tests/runner.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
#0 8.677   copying psutil/tests/test_memleaks.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
#0 8.677   copying psutil/tests/test_testutils.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
#0 8.677   copying psutil/tests/test_process.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
#0 8.677   copying psutil/tests/test_posix.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
#0 8.677   copying psutil/tests/test_windows.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
#0 8.677   copying psutil/tests/test_unicode.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
#0 8.677   copying psutil/tests/test_osx.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
#0 8.677   copying psutil/tests/test_aix.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
#0 8.677   copying psutil/tests/test_misc.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
#0 8.677   copying psutil/tests/test_contracts.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
#0 8.677   copying psutil/tests/test_sunos.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
#0 8.677   copying psutil/tests/test_linux.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
#0 8.677   copying psutil/tests/__init__.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
#0 8.677   copying psutil/tests/test_system.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
#0 8.677   running build_ext
#0 8.677   building 'psutil._psutil_linux' extension
#0 8.677   creating build/temp.linux-aarch64-cpython-310
#0 8.677   creating build/temp.linux-aarch64-cpython-310/psutil
#0 8.677   aarch64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -DPSUTIL_POSIX=1 -DPSUTIL_SIZEOF_PID_T=4 -DPSUTIL_VERSION=594 -DPy_LIMITED_API=0x03060000 -DPSUTIL_LINUX=1 -I/tmp/tmpz6bfv_zl/.venv/include -I/usr/include/python3.10 -c psutil/_psutil_common.c -o build/temp.linux-aarch64-cpython-310/psutil/_psutil_common.o
#0 8.677   psutil/_psutil_common.c:9:10: fatal error: Python.h: No such file or directory
#0 8.677       9 | #include <Python.h>
#0 8.677         |          ^~~~~~~~~~
#0 8.677   compilation terminated.
#0 8.677   error: command '/usr/bin/aarch64-linux-gnu-gcc' failed with exit code 1
#0 8.677   
#0 8.677 
#0 8.677   at ~/.local/share/pypoetry/venv/lib/python3.8/site-packages/poetry/installation/chef.py:152 in _prepare
#0 8.684       148│ 
#0 8.685       149│                 error = ChefBuildError("\n\n".join(message_parts))
#0 8.685       150│ 
#0 8.685       151│             if error is not None:
#0 8.685     → 152│                 raise error from None
#0 8.685       153│ 
#0 8.685       154│             return path
#0 8.685       155│ 
#0 8.685       156│     def _prepare_sdist(self, archive: Path, destination: Path | None = None) -> Path:
#0 8.686 
#0 8.686 Note: This error originates from the build backend, and is likely not a problem with poetry but with psutil (5.9.4) not supporting PEP 517 builds. You can verify this by running 'pip wheel --use-pep517 "psutil (==5.9.4)"'.
#0 8.686 
------
failed to solve: executor failed running [/bin/sh -c poetry install --with tools,gpu]: exit code: 1
hanchchch commented 1 year ago

Hi! Thanks for your interest in this project.

Looks like there's some issue on eval.gpu service of docker-compose.yml. I just reproduced the issue on my ARM Mac machine.

Honestly we haven't looked into the version with gpu for a while 'cause we were focusing on the process management. Thanks for reporting and we'll take a look on it as soon as possible.

You can still use without-gpu version, try docker-compose up eval. I think I should also update this on README!

ChristianWeyer commented 1 year ago

Thanks!

How do we get started asking things now?

image
hanchchch commented 1 year ago

I just added how to send request on README. Sorry that we don't have GUI yet, you might need to send request by using terminal or other HTTP clients.

ChristianWeyer commented 1 year ago

Wonderful, thank you.