search

datahub-project / datahub

The Metadata Platform for your Data Stack
https://datahubproject.io
Apache License 2.0
9.88k stars 2.92k forks source link

Failed to ./gradlew :metadata-ingestion:installDev #4648

Closed hooverhe closed 2 years ago

hooverhe commented 2 years ago

When I execute "./gradlew :metadata-ingestion:installDev", I failed.

My Dev Env: Centos 7 or 8. In both of them I can't build successfully in several days. OpenJDK8U-jdk_x64_linux_hotspot_8u322b06 Docker version 20.10.9, build c2ea9bc docker-compose version 1.29.2, build 5becea4c python 3.6.8 pip 21.3.1 from /usr/local/lib/python3.6/site-packages/pip (python 3.6) git version 2.27.0

Debug Log: 2022-04-12T23:57:06.227+0800 [ERROR] [system.err] + venv/bin/pip install -e '.[dev]' 2022-04-12T23:57:06.708+0800 [QUIET] [system.out] Looking in indexes: http://mirrors.tencentyun.com/pypi/simple 2022-04-12T23:57:52.128+0800 [QUIET] [system.out] Requirement already satisfied: dnspython>=1.15.0 in ./venv/lib/python3.6/site-packages (from email-validator<2,>=1.0.5->flask-appbuilder==3.4.5->apache-airflow[snowflake]>=2.0.2->acryl-datahub==0.0.0.dev0) (2.2.1) 2022-04-12T23:57:52.167+0800 [QUIET] [system.out] Requirement already satisfied: Babel>=2.3 in ./venv/lib/python3.6/site-packages (from Flask-Babel<3,>=1->flask-appbuilder==3.4.5->apache-airflow[snowflake]>=2.0.2->acryl-datahub==0.0.0.dev0) (2.9.1) 2022-04-12T23:57:52.343+0800 [QUIET] [system.out] Requirement already satisfied: google-crc32c<2.0dev,>=1.0 in ./venv/lib/python3.6/site-packages (from google-resumable-media<3.0dev,>=0.6.0->google-cloud-bigquery<4.0.0dev,>=2.25.2->sqlalchemy-bigquery>=1.4.1->acryl-datahub==0.0.0.dev0) (1.3.0) 2022-04-12T23:57:52.523+0800 [QUIET] [system.out] Requirement already satisfied: h11<0.13,>=0.11 in ./venv/lib/python3.6/site-packages (from httpcore<0.15.0,>=0.14.5->httpx->apache-airflow[snowflake]>=2.0.2->acryl-datahub==0.0.0.dev0) (0.12.0) 2022-04-12T23:57:52.523+0800 [QUIET] [system.out] Requirement already satisfied: anyio==3.* in ./venv/lib/python3.6/site-packages (from httpcore<0.15.0,>=0.14.5->httpx->apache-airflow[snowflake]>=2.0.2->acryl-datahub==0.0.0.dev0) (3.5.0) 2022-04-12T23:57:52.560+0800 [QUIET] [system.out] Requirement already satisfied: contextvars>=2.1 in ./venv/lib/python3.6/site-packages (from sniffio->httpx->apache-airflow[snowflake]>=2.0.2->acryl-datahub==0.0.0.dev0) (2.4) 2022-04-12T23:57:52.757+0800 [QUIET] [system.out] Requirement already satisfied: parso<0.8.0,>=0.7.0 in ./venv/lib/python3.6/site-packages (from jedi<=0.17.2,>=0.10->Ipython>=7.16.3->great-expectations>=0.14.11->acryl-datahub==0.0.0.dev0) (0.7.1) 2022-04-12T23:57:53.107+0800 [QUIET] [system.out] Requirement already satisfied: et-xmlfile in ./venv/lib/python3.6/site-packages (from openpyxl>=2.6->tabulator>=1.51.3->tableschema>=1.20.2->acryl-datahub==0.0.0.dev0) (1.1.0) 2022-04-12T23:57:53.216+0800 [QUIET] [system.out] Requirement already satisfied: wcwidth in ./venv/lib/python3.6/site-packages (from prompt-toolkit!=3.0.0,!=3.0.1,<3.1.0,>=2.0.0->Ipython>=7.16.3->great-expectations>=0.14.11->acryl-datahub==0.0.0.dev0) (0.2.5) 2022-04-12T23:57:54.410+0800 [QUIET] [system.out] Requirement already satisfied: ptyprocess>=0.5 in ./venv/lib/python3.6/site-packages (from pexpect->Ipython>=7.16.3->great-expectations>=0.14.11->acryl-datahub==0.0.0.dev0) (0.7.0) 2022-04-12T23:57:54.489+0800 [QUIET] [system.out] Requirement already satisfied: tzdata in ./venv/lib/python3.6/site-packages (from pytz-deprecation-shim->tzlocal->avro-gen3==0.7.2->acryl-datahub==0.0.0.dev0) (2022.1) 2022-04-12T23:57:54.598+0800 [QUIET] [system.out] Requirement already satisfied: immutables>=0.9 in ./venv/lib/python3.6/site-packages (from contextvars>=2.1->sniffio->httpx->apache-airflow[snowflake]>=2.0.2->acryl-datahub==0.0.0.dev0) (0.17) 2022-04-12T23:57:54.774+0800 [QUIET] [system.out] Requirement already satisfied: pynacl>=1.0.1 in ./venv/lib/python3.6/site-packages (from paramiko>=2.4.2->docker->acryl-datahub==0.0.0.dev0) (1.5.0) 2022-04-12T23:57:54.775+0800 [QUIET] [system.out] Requirement already satisfied: bcrypt>=3.1.3 in ./venv/lib/python3.6/site-packages (from paramiko>=2.4.2->docker->acryl-datahub==0.0.0.dev0) (3.2.0) 2022-04-12T23:57:55.312+0800 [QUIET] [system.out] Building wheels for collected packages: sasl3 2022-04-12T23:57:55.312+0800 [QUIET] [system.out] Building wheel for sasl3 (setup.py): started 2022-04-12T23:57:55.817+0800 [QUIET] [system.out] Building wheel for sasl3 (setup.py): finished with status 'error' 2022-04-12T23:57:55.817+0800 [ERROR] [system.err] ERROR: Command errored out with exit status 1: 2022-04-12T23:57:55.817+0800 [ERROR] [system.err] command: /opt/datahub/metadata-ingestion/venv/bin/python -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-km8e90tc/sasl3_c07bbcd7ac0748b0a2586076fa2b3d8c/setup.py'"'"'; file='"'"'/tmp/pip-install-km8e90tc/sasl3_c07bbcd7ac0748b0a2586076fa2b3d8c/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(file) if os.path.exists(file) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-gl4sx0xq 2022-04-12T23:57:55.817+0800 [ERROR] [system.err] cwd: /tmp/pip-install-km8e90tc/sasl3_c07bbcd7ac0748b0a2586076fa2b3d8c/ 2022-04-12T23:57:55.817+0800 [ERROR] [system.err] Complete output (34 lines): 2022-04-12T23:57:55.817+0800 [ERROR] [system.err] /opt/datahub/metadata-ingestion/venv/lib64/python3.6/site-packages/setuptools/dist.py:700: UserWarning: Usage of dash-separated 'index-url' will not be supported in future versions. Please use the underscore name 'index_url' instead 2022-04-12T23:57:55.817+0800 [ERROR] [system.err] % (opt, underscore_opt)) 2022-04-12T23:57:55.817+0800 [ERROR] [system.err] /opt/datahub/metadata-ingestion/venv/lib64/python3.6/site-packages/setuptools/dist.py:700: UserWarning: Usage of dash-separated 'description-file' will not be supported in future versions. Please use the underscore name 'description_file' instead 2022-04-12T23:57:55.817+0800 [ERROR] [system.err] % (opt, underscore_opt)) 2022-04-12T23:57:55.817+0800 [QUIET] [system.out] Running setup.py clean for sasl3 2022-04-12T23:57:55.817+0800 [ERROR] [system.err] running bdist_wheel 2022-04-12T23:57:55.817+0800 [ERROR] [system.err] running build 2022-04-12T23:57:55.817+0800 [ERROR] [system.err] running build_py 2022-04-12T23:57:55.818+0800 [ERROR] [system.err] creating build 2022-04-12T23:57:55.818+0800 [ERROR] [system.err] creating build/lib.linux-x86_64-3.6 2022-04-12T23:57:55.818+0800 [ERROR] [system.err] creating build/lib.linux-x86_64-3.6/sasl 2022-04-12T23:57:55.818+0800 [ERROR] [system.err] copying sasl/init.py -> build/lib.linux-x86_64-3.6/sasl 2022-04-12T23:57:55.818+0800 [ERROR] [system.err] running egg_info 2022-04-12T23:57:55.818+0800 [ERROR] [system.err] writing sasl3.egg-info/PKG-INFO 2022-04-12T23:57:55.818+0800 [ERROR] [system.err] writing dependency_links to sasl3.egg-info/dependency_links.txt 2022-04-12T23:57:55.818+0800 [ERROR] [system.err] writing requirements to sasl3.egg-info/requires.txt 2022-04-12T23:57:55.818+0800 [ERROR] [system.err] writing top-level names to sasl3.egg-info/top_level.txt 2022-04-12T23:57:55.818+0800 [ERROR] [system.err] reading manifest file 'sasl3.egg-info/SOURCES.txt' 2022-04-12T23:57:55.818+0800 [ERROR] [system.err] reading manifest template 'MANIFEST.in' 2022-04-12T23:57:55.818+0800 [ERROR] [system.err] adding license file 'LICENSE.txt' 2022-04-12T23:57:55.818+0800 [ERROR] [system.err] writing manifest file 'sasl3.egg-info/SOURCES.txt' 2022-04-12T23:57:55.818+0800 [ERROR] [system.err] copying sasl/saslwrapper.cpp -> build/lib.linux-x86_64-3.6/sasl 2022-04-12T23:57:55.818+0800 [ERROR] [system.err] copying sasl/saslwrapper.h -> build/lib.linux-x86_64-3.6/sasl 2022-04-12T23:57:55.818+0800 [ERROR] [system.err] copying sasl/saslwrapper.pyx -> build/lib.linux-x86_64-3.6/sasl 2022-04-12T23:57:55.818+0800 [ERROR] [system.err] running build_ext 2022-04-12T23:57:55.818+0800 [ERROR] [system.err] building 'sasl.saslwrapper' extension 2022-04-12T23:57:55.818+0800 [ERROR] [system.err] creating build/temp.linux-x86_64-3.6 2022-04-12T23:57:55.818+0800 [ERROR] [system.err] creating build/temp.linux-x86_64-3.6/sasl 2022-04-12T23:57:55.818+0800 [ERROR] [system.err] gcc -pthread -Wno-unused-result -Wsign-compare -DDYNAMIC_ANNOTATIONS_ENABLED=1 -DNDEBUG -O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fexceptions -fstack-protector-strong -grecord-gcc-switches -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_GNU_SOURCE -fPIC -fwrapv -O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fexceptions -fstack-protector-strong -grecord-gcc-switches -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_GNU_SOURCE -fPIC -fwrapv -O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fexceptions -fstack-protector-strong -grecord-gcc-switches -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_GNU_SOURCE -fPIC -fwrapv -fPIC -Isasl -I/opt/datahub/metadata-ingestion/venv/include -I/usr/include/python3.6m -c sasl/saslwrapper.cpp -o build/temp.linux-x86_64-3.6/sasl/saslwrapper.o 2022-04-12T23:57:55.818+0800 [ERROR] [system.err] In file included from sasl/saslwrapper.cpp:617: 2022-04-12T23:57:55.818+0800 [ERROR] [system.err] sasl/saslwrapper.h:22:10: fatal error: sasl/sasl.h: No such file or directory 2022-04-12T23:57:55.818+0800 [ERROR] [system.err] #include <sasl/sasl.h> 2022-04-12T23:57:55.819+0800 [ERROR] [system.err] ^~~~~ 2022-04-12T23:57:55.819+0800 [ERROR] [system.err] compilation terminated. 2022-04-12T23:57:55.819+0800 [ERROR] [system.err] error: command 'gcc' failed with exit status 1 2022-04-12T23:57:55.819+0800 [ERROR] [system.err] ---------------------------------------- 2022-04-12T23:57:55.819+0800 [ERROR] [system.err] ERROR: Failed building wheel for sasl3 2022-04-12T23:57:56.207+0800 [QUIET] [system.out] Failed to build sasl3 2022-04-12T23:57:57.130+0800 [LIFECYCLE] [org.gradle.cache.internal.DefaultFileLockManager] 2022-04-12T23:57:57.130+0800 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Waiting to acquire shared lock on daemon addresses registry. 2022-04-12T23:57:57.130+0800 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Lock acquired on daemon addresses registry. 2022-04-12T23:57:57.130+0800 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Releasing lock on daemon addresses registry. 2022-04-12T23:57:57.130+0800 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Waiting to acquire shared lock on daemon addresses registry. 2022-04-12T23:57:57.130+0800 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Lock acquired on daemon addresses registry. 2022-04-12T23:57:57.130+0800 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Releasing lock on daemon addresses registry. 2022-04-12T23:57:56.199+0800 [LIFECYCLE] [class org.gradle.internal.buildevents.TaskExecutionLogger] 2022-04-12T23:57:56.199+0800 [LIFECYCLE] [class org.gradle.internal.buildevents.TaskExecutionLogger] > Task :metadata-ingestion:installDev 2022-04-12T23:58:02.360+0800 [QUIET] [system.out] Installing collected packages: sasl3, ruamel.yaml, requests-toolbelt, readme-renderer, python-jose, pytest, pydash, pycryptodome, py4j, pkginfo, pep517, pathspec, ordered-set, networkx, nbformat, mypy-boto3-sagemaker, mypy-boto3-s3, mypy-boto3-glue, mypy, moto, mistune, keyring, jsonpatch, isodate, Ipython, grpc-google-iam-v1, google-cloud-bigquery, google-cloud-audit-log, google-cloud-appengine-logging, flatdict, flask-cors, flake8, docker-compose, clickhouse-driver, bracex, boto3-stubs, apache-airflow-providers-snowflake, altair, aiohttp, aenum, acryl-pyhive, wcmatch, ujson, types-ujson, types-toml, types-tabulate, types-six, types-requests, types-PyYAML, types-pytz, types-python-dateutil, types-PyMySQL, types-pkg-resources, types-freezegun, types-dataclasses, types-click, types-cachetools, twine, tox, tableschema, tableauserverclient, sqllineage, sqlalchemy-stubs, sqlalchemy-redshift, sqlalchemy-bigquery, sql-metadata, requests-mock, redash-toolbelt, pytest-docker, pytest-cov, pytest-asyncio, pyspark, pymysql, pydeequ, psycopg2-binary, parse, orderedset, okta, msal, more-itertools, looker-sdk, jsonpickle, isort, greenlet, great-expectations, google-cloud-logging, GeoAlchemy2, freezegun, flake8-tidy-imports, fastavro, elasticsearch, deepdiff, cx-Oracle, confluent-kafka, clickhouse-sqlalchemy, build, black, acryl-datahub 2022-04-12T23:58:02.363+0800 [QUIET] [system.out] Running setup.py install for sasl3: started 2022-04-12T23:58:02.850+0800 [QUIET] [system.out] Running setup.py install for sasl3: finished with status 'error' 2022-04-12T23:58:02.850+0800 [ERROR] [system.err] ERROR: Command errored out with exit status 1: 2022-04-12T23:58:02.850+0800 [ERROR] [system.err] command: /opt/datahub/metadata-ingestion/venv/bin/python -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-km8e90tc/sasl3_c07bbcd7ac0748b0a2586076fa2b3d8c/setup.py'"'"'; file='"'"'/tmp/pip-install-km8e90tc/sasl3_c07bbcd7ac0748b0a2586076fa2b3d8c/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(file) if os.path.exists(file) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' install --record /tmp/pip-record-qtfkau9f/install-record.txt --single-version-externally-managed --compile --install-headers /opt/datahub/metadata-ingestion/venv/include/site/python3.6/sasl3 2022-04-12T23:58:02.850+0800 [ERROR] [system.err] cwd: /tmp/pip-install-km8e90tc/sasl3_c07bbcd7ac0748b0a2586076fa2b3d8c/ 2022-04-12T23:58:02.850+0800 [ERROR] [system.err] Complete output (34 lines): 2022-04-12T23:58:02.850+0800 [ERROR] [system.err] /opt/datahub/metadata-ingestion/venv/lib64/python3.6/site-packages/setuptools/dist.py:700: UserWarning: Usage of dash-separated 'index-url' will not be supported in future versions. Please use the underscore name 'index_url' instead 2022-04-12T23:58:02.850+0800 [ERROR] [system.err] % (opt, underscore_opt)) 2022-04-12T23:58:02.850+0800 [ERROR] [system.err] /opt/datahub/metadata-ingestion/venv/lib64/python3.6/site-packages/setuptools/dist.py:700: UserWarning: Usage of dash-separated 'description-file' will not be supported in future versions. Please use the underscore name 'description_file' instead 2022-04-12T23:58:02.850+0800 [ERROR] [system.err] % (opt, underscore_opt)) 2022-04-12T23:58:02.850+0800 [ERROR] [system.err] running install 2022-04-12T23:58:02.850+0800 [ERROR] [system.err] running build 2022-04-12T23:58:02.850+0800 [ERROR] [system.err] running build_py 2022-04-12T23:58:02.850+0800 [ERROR] [system.err] creating build 2022-04-12T23:58:02.850+0800 [ERROR] [system.err] creating build/lib.linux-x86_64-3.6 2022-04-12T23:58:02.850+0800 [ERROR] [system.err] creating build/lib.linux-x86_64-3.6/sasl 2022-04-12T23:58:02.850+0800 [ERROR] [system.err] copying sasl/init.py -> build/lib.linux-x86_64-3.6/sasl 2022-04-12T23:58:02.850+0800 [ERROR] [system.err] running egg_info 2022-04-12T23:58:02.850+0800 [ERROR] [system.err] writing sasl3.egg-info/PKG-INFO 2022-04-12T23:58:02.851+0800 [ERROR] [system.err] writing dependency_links to sasl3.egg-info/dependency_links.txt 2022-04-12T23:58:02.851+0800 [ERROR] [system.err] writing requirements to sasl3.egg-info/requires.txt 2022-04-12T23:58:02.851+0800 [ERROR] [system.err] writing top-level names to sasl3.egg-info/top_level.txt 2022-04-12T23:58:02.851+0800 [ERROR] [system.err] reading manifest file 'sasl3.egg-info/SOURCES.txt' 2022-04-12T23:58:02.851+0800 [ERROR] [system.err] reading manifest template 'MANIFEST.in' 2022-04-12T23:58:02.851+0800 [ERROR] [system.err] adding license file 'LICENSE.txt' 2022-04-12T23:58:02.851+0800 [ERROR] [system.err] writing manifest file 'sasl3.egg-info/SOURCES.txt' 2022-04-12T23:58:02.851+0800 [ERROR] [system.err] copying sasl/saslwrapper.cpp -> build/lib.linux-x86_64-3.6/sasl 2022-04-12T23:58:02.851+0800 [ERROR] [system.err] copying sasl/saslwrapper.h -> build/lib.linux-x86_64-3.6/sasl 2022-04-12T23:58:02.851+0800 [ERROR] [system.err] copying sasl/saslwrapper.pyx -> build/lib.linux-x86_64-3.6/sasl 2022-04-12T23:58:02.851+0800 [ERROR] [system.err] running build_ext 2022-04-12T23:58:02.851+0800 [ERROR] [system.err] building 'sasl.saslwrapper' extension 2022-04-12T23:58:02.851+0800 [ERROR] [system.err] creating build/temp.linux-x86_64-3.6 2022-04-12T23:58:02.851+0800 [ERROR] [system.err] creating build/temp.linux-x86_64-3.6/sasl 2022-04-12T23:58:02.851+0800 [ERROR] [system.err] gcc -pthread -Wno-unused-result -Wsign-compare -DDYNAMIC_ANNOTATIONS_ENABLED=1 -DNDEBUG -O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fexceptions -fstack-protector-strong -grecord-gcc-switches -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_GNU_SOURCE -fPIC -fwrapv -O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fexceptions -fstack-protector-strong -grecord-gcc-switches -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_GNU_SOURCE -fPIC -fwrapv -O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fexceptions -fstack-protector-strong -grecord-gcc-switches -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_GNU_SOURCE -fPIC -fwrapv -fPIC -Isasl -I/opt/datahub/metadata-ingestion/venv/include -I/usr/include/python3.6m -c sasl/saslwrapper.cpp -o build/temp.linux-x86_64-3.6/sasl/saslwrapper.o 2022-04-12T23:58:02.851+0800 [ERROR] [system.err] In file included from sasl/saslwrapper.cpp:617: 2022-04-12T23:58:02.851+0800 [ERROR] [system.err] sasl/saslwrapper.h:22:10: fatal error: sasl/sasl.h: No such file or directory 2022-04-12T23:58:02.851+0800 [ERROR] [system.err] #include <sasl/sasl.h> 2022-04-12T23:58:02.851+0800 [ERROR] [system.err] ^~~~~ 2022-04-12T23:58:02.851+0800 [ERROR] [system.err] compilation terminated. 2022-04-12T23:58:02.851+0800 [ERROR] [system.err] error: command 'gcc' failed with exit status 1 2022-04-12T23:58:02.851+0800 [ERROR] [system.err] ---------------------------------------- 2022-04-12T23:58:02.851+0800 [ERROR] [system.err] ERROR: Command errored out with exit status 1: /opt/datahub/metadata-ingestion/venv/bin/python -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-km8e90tc/sasl3_c07bbcd7ac0748b0a2586076fa2b3d8c/setup.py'"'"'; file='"'"'/tmp/pip-install-km8e90tc/sasl3_c07bbcd7ac0748b0a2586076fa2b3d8c/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(file) if os.path.exists(file) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' install --record /tmp/pip-record-qtfkau9f/install-record.txt --single-version-externally-managed --compile --install-headers /opt/datahub/metadata-ingestion/venv/include/site/python3.6/sasl3 Check the logs for full command output. 2022-04-12T23:58:03.486+0800 [DEBUG] [org.gradle.process.internal.DefaultExecHandle] Changing state to: FAILED 2022-04-12T23:58:03.487+0800 [DEBUG] [org.gradle.process.internal.DefaultExecHandle] Process 'command 'bash'' finished with exit value 1 (state: FAILED) 2022-04-12T23:58:03.487+0800 [LIFECYCLE] [org.gradle.internal.operations.DefaultBuildOperationRunner] 2022-04-12T23:58:03.487+0800 [DEBUG] [org.gradle.internal.operations.DefaultBuildOperationRunner] Completing Build operation 'Execute exec for :metadata-ingestion:installDev' 2022-04-12T23:58:03.487+0800 [DEBUG] [org.gradle.internal.operations.DefaultBuildOperationRunner] Completing Build operation 'Executing task ':metadata-ingestion:installDev'' 2022-04-12T23:58:03.488+0800 [DEBUG] [org.gradle.internal.operations.DefaultBuildOperationRunner] Build operation 'Snapshot outputs after executing task ':metadata-ingestion:installDev'' started 2022-04-12T23:58:04.046+0800 [DEBUG] [org.gradle.internal.operations.DefaultBuildOperationRunner] Completing Build operation 'Snapshot outputs after executing task ':metadata-ingestion:installDev'' 2022-04-12T23:58:03.398+0800 [LIFECYCLE] [class org.gradle.internal.buildevents.TaskExecutionLogger] 2022-04-12T23:58:03.398+0800 [LIFECYCLE] [class org.gradle.internal.buildevents.TaskExecutionLogger] > Task :metadata-ingestion:installDev FAILED 2022-04-12T23:58:03.487+0800 [DEBUG] [org.gradle.internal.operations.DefaultBuildOperationRunner] Build operation 'Execute exec for :metadata-ingestion:installDev' completed 2022-04-12T23:58:03.488+0800 [DEBUG] [org.gradle.internal.operations.DefaultBuildOperationRunner] Build operation 'Executing task ':metadata-ingestion:installDev'' completed 2022-04-12T23:58:04.046+0800 [DEBUG] [org.gradle.internal.operations.DefaultBuildOperationRunner] Build operation 'Snapshot outputs after executing task ':metadata-ingestion:installDev'' completed 2022-04-12T23:58:04.048+0800 [DEBUG] [org.gradle.api.internal.tasks.execution.ResolveTaskExecutionModeExecuter] Removed task artifact state for task ':metadata-ingestion:installDev' from context. 2022-04-12T23:58:04.048+0800 [DEBUG] [org.gradle.internal.operations.DefaultBuildOperationRunner] Completing Build operation 'Task :metadata-ingestion:installDev' 2022-04-12T23:58:04.048+0800 [DEBUG] [org.gradle.internal.operations.DefaultBuildOperationRunner] Build operation 'Task :metadata-ingestion:installDev' completed 2022-04-12T23:58:04.048+0800 [INFO] [org.gradle.execution.plan.DefaultPlanExecutor] :metadata-ingestion:installDev (Thread[Execution worker for ':' Thread 3,5,main]) completed. Took 57.996 secs. 2022-04-12T23:58:04.048+0800 [DEBUG] [org.gradle.execution.plan.DefaultExecutionPlan] Node :metadata-ingestion:installDev failed 2022-04-12T23:58:04.048+0800 [DEBUG] [org.gradle.execution.plan.DefaultExecutionPlan] Node :metadata-ingestion:installDev completed, executed: true 2022-04-12T23:58:04.048+0800 [DEBUG] [org.gradle.internal.resources.AbstractTrackedResourceLock] Execution worker for ':' Thread 3: released lock on :metadata-ingestion 2022-04-12T23:58:04.048+0800 [DEBUG] [org.gradle.internal.work.DefaultWorkerLeaseService] Worker lease root.1.23 completed (1 worker(s) in use) 2022-04-12T23:58:04.048+0800 [DEBUG] [org.gradle.internal.resources.AbstractTrackedResourceLock] Execution worker for ':' Thread 3: released lock on root.1.23 2022-04-12T23:58:04.048+0800 [DEBUG] [org.gradle.execution.plan.DefaultPlanExecutor] Execution worker [Thread[Execution worker for ':' Thread 3,5,main]] finished, busy: 58.23 secs, idle: 3.822 secs 2022-04-12T23:58:04.048+0800 [DEBUG] [org.gradle.execution.plan.DefaultPlanExecutor] Execution worker [Thread[Daemon worker,5,main]] finished, busy: 0.438 secs, idle: 1 mins 1.612 secs 2022-04-12T23:58:04.049+0800 [DEBUG] [org.gradle.execution.plan.DefaultPlanExecutor] Execution worker [Thread[Execution worker for ':' Thread 7,5,main]] finished, busy: 0.0 secs, idle: 1 mins 2.051 secs 2022-04-12T23:58:04.049+0800 [DEBUG] [org.gradle.execution.plan.DefaultPlanExecutor] Execution worker [Thread[Execution worker for ':' Thread 11,5,main]] finished, busy: 0.0 secs, idle: 1 mins 2.05 secs 2022-04-12T23:58:04.049+0800 [DEBUG] [org.gradle.execution.plan.DefaultPlanExecutor] Execution worker [Thread[Execution worker for ':' Thread 14,5,main]] finished, busy: 0.0 secs, idle: 1 mins 2.05 secs 2022-04-12T23:58:04.049+0800 [DEBUG] [org.gradle.execution.plan.DefaultPlanExecutor] Execution worker [Thread[Execution worker for ':',5,main]] finished, busy: 0.0 secs, idle: 1 mins 2.052 secs 2022-04-12T23:58:04.049+0800 [DEBUG] [org.gradle.execution.plan.DefaultPlanExecutor] Execution worker [Thread[Execution worker for ':' Thread 15,5,main]] finished, busy: 3.749 secs, idle: 58.301 secs 2022-04-12T23:58:04.049+0800 [DEBUG] [org.gradle.execution.plan.DefaultPlanExecutor] Execution worker [Thread[Execution worker for ':' Thread 6,5,main]] finished, busy: 0.0 secs, idle: 1 mins 2.051 secs 2022-04-12T23:58:04.049+0800 [DEBUG] [org.gradle.execution.plan.DefaultPlanExecutor] Execution worker [Thread[Execution worker for ':' Thread 13,5,main]] finished, busy: 0.0 secs, idle: 1 mins 2.05 secs 2022-04-12T23:58:04.048+0800 [DEBUG] [org.gradle.execution.plan.DefaultPlanExecutor] Execution worker [Thread[Execution worker for ':' Thread 2,5,main]] finished, busy: 2.0 secs, idle: 1 mins 0.052 secs 2022-04-12T23:58:04.048+0800 [DEBUG] [org.gradle.execution.plan.DefaultPlanExecutor] Execution worker [Thread[Execution worker for ':' Thread 12,5,main]] finished, busy: 0.0 secs, idle: 1 mins 2.05 secs 2022-04-12T23:58:04.049+0800 [DEBUG] [org.gradle.execution.plan.DefaultPlanExecutor] Execution worker [Thread[Execution worker for ':' Thread 8,5,main]] finished, busy: 0.0 secs, idle: 1 mins 2.051 secs 2022-04-12T23:58:04.049+0800 [DEBUG] [org.gradle.execution.plan.DefaultPlanExecutor] Execution worker [Thread[Execution worker for ':' Thread 10,5,main]] finished, busy: 0.0 secs, idle: 1 mins 2.051 secs 2022-04-12T23:58:04.049+0800 [DEBUG] [org.gradle.execution.plan.DefaultPlanExecutor] Execution worker [Thread[Execution worker for ':' Thread 9,5,main]] finished, busy: 0.0 secs, idle: 1 mins 2.051 secs 2022-04-12T23:58:04.049+0800 [DEBUG] [org.gradle.execution.plan.DefaultPlanExecutor] Execution worker [Thread[Execution worker for ':' Thread 5,5,main]] finished, busy: 0.0 secs, idle: 1 mins 2.052 secs 2022-04-12T23:58:04.049+0800 [DEBUG] [org.gradle.execution.plan.DefaultPlanExecutor] Execution worker [Thread[Execution worker for ':' Thread 4,5,main]] finished, busy: 0.0 secs, idle: 1 mins 2.052 secs 2022-04-12T23:58:04.052+0800 [DEBUG] [org.gradle.execution.taskgraph.DefaultTaskExecutionGraph] Timing: Executing the DAG took 1 mins 2.058 secs 2022-04-12T23:58:04.056+0800 [DEBUG] [org.gradle.internal.operations.DefaultBuildOperationRunner] Completing Build operation 'Run tasks' 2022-04-12T23:58:04.056+0800 [DEBUG] [org.gradle.internal.operations.DefaultBuildOperationRunner] Build operation 'Run tasks' completed 2022-04-12T23:58:04.060+0800 [DEBUG] [org.gradle.internal.work.DefaultWorkerLeaseService] Worker lease root.1 completed (0 worker(s) in use) 2022-04-12T23:58:04.060+0800 [DEBUG] [org.gradle.internal.resources.AbstractTrackedResourceLock] Daemon worker: released lock on root.1 2022-04-12T23:58:04.065+0800 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] 2022-04-12T23:58:04.065+0800 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] FAILURE: Build failed with an exception. 2022-04-12T23:58:04.065+0800 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] 2022-04-12T23:58:04.065+0800 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] What went wrong: 2022-04-12T23:58:04.065+0800 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] Execution failed for task ':metadata-ingestion:installDev'. 2022-04-12T23:58:04.065+0800 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] > Process 'command 'bash'' finished with non-zero exit value 1 2022-04-12T23:58:04.066+0800 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] 2022-04-12T23:58:04.066+0800 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] Try: 2022-04-12T23:58:04.066+0800 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] Run with --stacktrace option to get the stack trace. Run with --scan to get full insights. 2022-04-12T23:58:04.066+0800 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] 2022-04-12T23:58:04.066+0800 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] * Get more help at https://help.gradle.org 2022-04-12T23:58:04.066+0800 [WARN] [org.gradle.internal.featurelifecycle.LoggingDeprecatedFeatureHandler] Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.2/userguide/command_line_interface.html#sec:command_line_warnings 2022-04-12T23:58:04.066+0800 [ERROR] [org.gradle.internal.buildevents.BuildResultLogger] 2022-04-12T23:58:04.066+0800 [ERROR] [org.gradle.internal.buildevents.BuildResultLogger] BUILD FAILED in 1m 8s 2022-04-12T23:58:04.067+0800 [LIFECYCLE] [org.gradle.internal.buildevents.TaskExecutionStatisticsReporter] 26 actionable tasks: 9 executed, 17 up-to-date 2022-04-12T23:58:04.069+0800 [DEBUG] [org.gradle.internal.operations.DefaultBuildOperationRunner] Build operation 'Build finished for file system watching' started 2022-04-12T23:58:04.069+0800 [DEBUG] [org.gradle.internal.operations.DefaultBuildOperationRunner] Completing Build operation 'Build finished for file system watching' 2022-04-12T23:58:04.069+0800 [DEBUG] [org.gradle.internal.operations.DefaultBuildOperationRunner] Build operation 'Build finished for file system watching' completed 2022-04-12T23:58:04.069+0800 [DEBUG] [org.gradle.internal.operations.DefaultBuildOperationRunner] Completing Build operation 'Run build' 2022-04-12T23:58:04.070+0800 [DEBUG] [org.gradle.internal.operations.DefaultBuildOperationRunner] Build operation 'Run build' completed 2022-04-12T23:58:04.093+0800 [DEBUG] [org.gradle.cache.internal.LockOnDemandCrossProcessCacheAccess] Releasing file lock for cache directory md-supplier (/root/.gradle/caches/6.9.2/md-supplier) 2022-04-12T23:58:04.093+0800 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Releasing lock on cache directory md-supplier (/root/.gradle/caches/6.9.2/md-supplier). 2022-04-12T23:58:04.098+0800 [DEBUG] [org.gradle.cache.internal.LockOnDemandCrossProcessCacheAccess] Releasing file lock for Build Output Cleanup Cache (/opt/datahub/.gradle/buildOutputCleanup) 2022-04-12T23:58:04.098+0800 [DEBUG] [org.gradle.cache.internal.btree.BTreePersistentIndexedCache] Closing cache outputFiles.bin (/opt/datahub/.gradle/buildOutputCleanup/outputFiles.bin) 2022-04-12T23:58:04.098+0800 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Releasing lock on Build Output Cleanup Cache (/opt/datahub/.gradle/buildOutputCleanup). 2022-04-12T23:58:04.099+0800 [DEBUG] [org.gradle.cache.internal.LockOnDemandCrossProcessCacheAccess] Releasing file lock for execution history cache (/opt/datahub/.gradle/6.9.2/executionHistory) 2022-04-12T23:58:04.099+0800 [DEBUG] [org.gradle.cache.internal.btree.BTreePersistentIndexedCache] Closing cache executionHistory.bin (/opt/datahub/.gradle/6.9.2/executionHistory/executionHistory.bin) 2022-04-12T23:58:04.099+0800 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Releasing lock on execution history cache (/opt/datahub/.gradle/6.9.2/executionHistory). 2022-04-12T23:58:04.100+0800 [DEBUG] [org.gradle.cache.internal.LockOnDemandCrossProcessCacheAccess] Releasing file lock for cache directory md-rule (/root/.gradle/caches/6.9.2/md-rule) 2022-04-12T23:58:04.100+0800 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Releasing lock on cache directory md-rule (/root/.gradle/caches/6.9.2/md-rule). 2022-04-12T23:58:04.101+0800 [DEBUG] [org.gradle.api.internal.artifacts.ivyservice.resolveengine.store.CachedStoreFactory] Resolution result cache closed. Cache reads: 0, disk reads: 0 (avg: 0.0 secs, total: 0.0 secs) 2022-04-12T23:58:04.101+0800 [DEBUG] [org.gradle.api.internal.artifacts.ivyservice.resolveengine.store.CachedStoreFactory] Resolution result cache closed. Cache reads: 0, disk reads: 0 (avg: 0.0 secs, total: 0.0 secs) 2022-04-12T23:58:04.101+0800 [DEBUG] [org.gradle.api.internal.artifacts.ivyservice.resolveengine.store.ResolutionResultsStoreFactory] Deleted 4 resolution results binary files in 0.0 secs 2022-04-12T23:58:04.105+0800 [DEBUG] [org.gradle.deployment.internal.DefaultDeploymentRegistry] Stopping 0 deployment handles 2022-04-12T23:58:04.105+0800 [DEBUG] [org.gradle.deployment.internal.DefaultDeploymentRegistry] Stopped deployment handles 2022-04-12T23:58:04.105+0800 [DEBUG] [org.gradle.cache.internal.LockOnDemandCrossProcessCacheAccess] Releasing file lock for file hash cache (/opt/datahub/.gradle/6.9.2/fileHashes) 2022-04-12T23:58:04.105+0800 [DEBUG] [org.gradle.cache.internal.btree.BTreePersistentIndexedCache] Closing cache fileHashes.bin (/opt/datahub/.gradle/6.9.2/fileHashes/fileHashes.bin) 2022-04-12T23:58:04.105+0800 [DEBUG] [org.gradle.cache.internal.btree.BTreePersistentIndexedCache] Closing cache resourceHashesCache.bin (/opt/datahub/.gradle/6.9.2/fileHashes/resourceHashesCache.bin) 2022-04-12T23:58:04.105+0800 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Releasing lock on file hash cache (/opt/datahub/.gradle/6.9.2/fileHashes). 2022-04-12T23:58:04.106+0800 [DEBUG] [org.gradle.cache.internal.LockOnDemandCrossProcessCacheAccess] Releasing file lock for checksums cache (/opt/datahub/.gradle/checksums) 2022-04-12T23:58:04.106+0800 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Releasing lock on checksums cache (/opt/datahub/.gradle/checksums). 2022-04-12T23:58:04.106+0800 [DEBUG] [org.gradle.cache.internal.DefaultPersistentDirectoryStore] VCS Checkout Cache (/opt/datahub/.gradle/vcs-1) has last been fully cleaned up 1 hours ago 2022-04-12T23:58:04.106+0800 [DEBUG] [org.gradle.cache.internal.DefaultCacheAccess] Cache VCS Checkout Cache (/opt/datahub/.gradle/vcs-1) was closed 0 times. 2022-04-12T23:58:04.106+0800 [DEBUG] [org.gradle.cache.internal.DefaultCacheAccess] Cache VCS metadata (/opt/datahub/.gradle/6.9.2/vcsMetadata-1) was closed 0 times. 2022-04-12T23:58:04.112+0800 [DEBUG] [org.gradle.launcher.daemon.server.exec.ExecuteBuild] The daemon has finished executing the build. 2022-04-12T23:58:04.141+0800 [DEBUG] [org.gradle.launcher.daemon.client.DaemonClientInputForwarder] Dispatching close input message: org.gradle.launcher.daemon.protocol.CloseInput@32fd8bed 2022-04-12T23:58:04.141+0800 [DEBUG] [org.gradle.launcher.daemon.client.DaemonClientConnection] thread 27: dispatching class org.gradle.launcher.daemon.protocol.CloseInput 2022-04-12T23:58:04.142+0800 [DEBUG] [org.gradle.launcher.daemon.client.DaemonClient] Received result Success[value=org.gradle.launcher.exec.BuildActionResult@2cb4893b] from daemon DaemonInfo{pid=88615, address=[5f7c8af1-25ce-47ff-9721-f3af511e4ea3 port:34163, addresses:[/127.0.0.1]], state=Busy, lastBusy=1649779017121, context=DefaultDaemonContext[uid=a9d25440-c286-4d9d-a36f-27822ec5f6f5,javaHome=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-2.el8_5.x86_64,daemonRegistryDir=/root/.gradle/daemon,pid=88615,idleTimeout=120000,priority=NORMAL,daemonOpts=-XX:MaxMetaspaceSize=256m,-XX:+HeapDumpOnOutOfMemoryError,-Xms256m,-Xmx512m,-Dfile.encoding=UTF-8,-Duser.country=US,-Duser.language=en,-Duser.variant]} (build should be done). 2022-04-12T23:58:04.142+0800 [DEBUG] [org.gradle.launcher.daemon.client.DaemonClientConnection] thread 1: dispatching class org.gradle.launcher.daemon.protocol.Finished 2022-04-12T23:58:04.142+0800 [LIFECYCLE] [org.gradle.launcher.cli.DebugLoggerWarningAction] ############################################################################# WARNING WARNING WARNING WARNING WARNING WARNING WARNING WARNING WARNING

Debug level logging will leak security sensitive information!

https://docs.gradle.org/6.9.2/userguide/logging.html#sec:debug_security #############################################################################

shirshanka commented 2 years ago

Looks like it is failing to install the libsasl2 dependency. Can you try to install it directly? Perhaps using yum install libsasl2-dev libsasl2-modules

hooverhe commented 2 years ago

Greate. It works fine. Many Thanks.