apache-airflow[all] resolution.

[tdejager]

Apache airflow seems to be a good package to test because it has a lot of dependencies.

Currently, it resolve to this version:

Resolved environment:
- apache-airflow[all]

Name                 Version
apache-airflow[all]  1.10.2

with no dependencies listed, which is incorrect, because of this probably:

https://github.com/prefix-dev/rip/pull/71#discussion_r1391483149

Let's track this issue for when we can actually solve it. We need #32 for this as well with sdist building.

[tdejager]

So #84 now actually gets a lot further regarding this issue.

We now get this error

Error reading metadata from artifact 'snowflake-connector-python-2.9.0.tar.gz' skipping (Could not resolve environment for wheel building)
thread 'main' panicked at 'could not find metadata for any sdist or wheel for snowflake-connector-python 2.9.0. The following artifacts are available:
- snowflake-connector-python-2.9.0.tar.gz', crates/rattler_installs_packages/src/resolve.rs:479:13
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

which is caused by needing recursive sdist support for which we need to solve #79 so we can install the built wheel.

[tdejager]

So now I'm having the problem where on my machine arm64-osx we are building an sdist that I cannot build namely pyarrow==8.0.0 however I don't think it should select this really old version as pip does not seem to do this. This could maybe be due to resolvo or something in rip itself.

I need to think of a good way to debug this, maybe @notatallshaw has an idea. I think it being caused by snowflake-connector-python==2.9.0 but again no idea why it has selected this version specifically.

[notatallshaw]

I would love to help but I don't really have any techniques or tools to investigaate why rip/resolvo made a certain choice like I do with pip/resolvelib.

By the way I get a very different error on Linux and pinning the version:

$ cargo r -- apache-airflow[all]==2.7.3
...
2023-12-05T23:57:13.796410Z  INFO rattler_installs_packages::resolve::dependency_provider: collecting apache-airflow[kerberos]
  × Could not solve for the requested requirements:
  │ The following packages are incompatible
  │ |-- apache-airflow[all] ==2.7.3 cannot be installed because there are no viable options:
  │     |-- apache-airflow[all] 2.7.3 would require
  │         |-- opentelemetry-exporter-prometheus *, which cannot be installed because there are no viable options:
  │             |-- opentelemetry-exporter-prometheus 1.12.0rc1 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 1.10a0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.42b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.41b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.40b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.39b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.38b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.37b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.36b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.35b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.34b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.33b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.32b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.30b1 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.30b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.29b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.17b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.16b1 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.16b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.15b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.14b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.13b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.12b0 is excluded because prereleases are not allowed

I beleive according to the spec an installer can (should?) choose a pre release package if there is no other option.

[notatallshaw]

Here's the spec on handling pre-releases: https://packaging.python.org/en/latest/specifications/version-specifiers/#handling-of-pre-releases

By the way, I think Pip doesn't handle this consistently between selecting packages initially (will select a pre release package if no other option is available even if --pre isn't given) and backtracking (won't select a pre release package at all unless --pre is given). I beleive this was previously discussed on a Pip issue: https://github.com/pypa/pip/issues/12049#issuecomment-1581027474

[notatallshaw]

I definetly think this contributes to why rip backtracks to such old versions of packages when trying the requirement apache-airflow[all], I've made a seperate issue for it: https://github.com/prefix-dev/rip/issues/118

[tdejager]

Thanks so much for looking into this! I'm first working on integrating it back into pixi and will look at this next I think 👍

[tdejager]

I would love to help but I don't really have any techniques or tools to investigaate why rip/resolvo made a certain choice like I do with pip/resolvelib.

By the way I get a very different error on Linux and pinning the version:

$ cargo r -- apache-airflow[all]==2.7.3
...
2023-12-05T23:57:13.796410Z  INFO rattler_installs_packages::resolve::dependency_provider: collecting apache-airflow[kerberos]
  × Could not solve for the requested requirements:
  │ The following packages are incompatible
  │ |-- apache-airflow[all] ==2.7.3 cannot be installed because there are no viable options:
  │     |-- apache-airflow[all] 2.7.3 would require
  │         |-- opentelemetry-exporter-prometheus *, which cannot be installed because there are no viable options:
  │             |-- opentelemetry-exporter-prometheus 1.12.0rc1 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 1.10a0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.42b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.41b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.40b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.39b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.38b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.37b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.36b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.35b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.34b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.33b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.32b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.30b1 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.30b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.29b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.17b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.16b1 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.16b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.15b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.14b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.13b0 is excluded because prereleases are not allowed
  │             |-- opentelemetry-exporter-prometheus 0.12b0 is excluded because prereleases are not allowed

I beleive according to the spec an installer can (should?) choose a pre release package if there is no other option.

I wanted to ask as well, what tools do you use to debug these things with pip/resolvelib?

[notatallshaw]

I wanted to ask as well, what tools do you use to debug these things with pip/resolvelib?

Ah, I think you're going to be fairly disappointed.

I usually start by putting some print statements around here that print out all unique cause names: https://github.com/pypa/pip/blob/23.3.1/src/pip/_vendor/resolvelib/resolvers.py#L430. This gives me a sense for what packages are changing the path of resolution from resolvelib's natural DFS, I also see when they're printed in the context of the logs, so it gives me a general idea what requirements have just been collected.

From that point it depends what the problem is.

For a complex backtracking I might add more information in the prints, such as the package versions of the causes, and also their parents name and version, this will allow me to construct a chain of what led to the final result.

If the issue is something that used to work but no longer does I might use pypi-timemachine and run the resolution on two different dates and see what the differences are.

And otherwise I will just change the requirements by adding upper bounds, changing the order, adding transitive dependencies into the requirements, and see how it affects it. Often though this is more to help a user who is stuck and needs to find a solution so they can continue to work.

[tdejager]

Cool! Thanks for giving insight into you problem-solving, I think for resolvo we also do a lot of print statements, when debugging. The large number of clauses can still make this pretty difficult though :)

I didn't know about pypi-timemachine that does sound pretty awesome! :)

[tdejager]

With #141 (which will hopefully be merged soon), I can resolve apache-airflow[all] on apple silicon:

My results:

Resolved environment:
- apache-airflow[all]

Name                                       Version
adal                                       1.2.7
adlfs                                      2023.12.0
aiobotocore                                2.9.0
aiofiles                                   23.2.1
aiohttp                                    3.9.1
aioitertools                               0.11.0
aiosignal                                  1.3.1
alembic                                    1.13.1
alibabacloud-adb20211201                   1.2.6
alibabacloud-credentials                   0.3.2
alibabacloud-endpoint-util                 0.0.3
alibabacloud-gateway-spi                   0.0.1
alibabacloud-openapi-util                  0.2.2
alibabacloud-tea                           0.3.5
alibabacloud-tea-openapi                   0.3.8
alibabacloud-tea-util                      0.3.11
alibabacloud-tea-xml                       0.0.2
aliyun-python-sdk-core                     2.14.0
aliyun-python-sdk-kms                      2.16.2
amqp                                       5.2.0
analytics-python                           1.2.9
annotated-types                            0.6.0
anyio                                      4.2.0
apache-airflow[all]                        2.8.0
apache-airflow-providers-airbyte           3.5.1
apache-airflow-providers-alibaba           2.7.1
apache-airflow-providers-amazon            8.16.0
apache-airflow-providers-apache-beam       5.5.0
apache-airflow-providers-apache-cassandra  3.4.1
apache-airflow-providers-apache-drill      2.6.0
apache-airflow-providers-apache-druid      3.7.0
apache-airflow-providers-apache-flink      1.3.0
apache-airflow-providers-apache-hdfs       4.3.2
apache-airflow-providers-apache-hive       6.4.1
apache-airflow-providers-apache-impala     1.3.0
apache-airflow-providers-apache-kafka      1.3.1
apache-airflow-providers-apache-kylin      3.5.0
apache-airflow-providers-apache-livy       3.7.1
apache-airflow-providers-apache-pig        4.3.0
apache-airflow-providers-apache-pinot      4.3.0
apache-airflow-providers-apache-spark      4.7.0
apache-airflow-providers-apprise           1.2.1
apache-airflow-providers-arangodb          2.4.1
apache-airflow-providers-asana             2.4.1
apache-airflow-providers-atlassian-jira    2.5.0
apache-airflow-providers-celery            3.5.1
apache-airflow-providers-cloudant          3.4.1
apache-airflow-providers-cncf-kubernetes   7.13.0
apache-airflow-providers-cohere            1.1.1
apache-airflow-providers-common-io         1.2.0
apache-airflow-providers-common-sql        1.10.0
apache-airflow-providers-databricks        6.0.0
apache-airflow-providers-datadog           3.5.1
apache-airflow-providers-dbt-cloud         3.5.1
apache-airflow-providers-dingding          3.4.0
apache-airflow-providers-discord           3.5.0
apache-airflow-providers-docker            3.9.1
apache-airflow-providers-elasticsearch     5.3.1
apache-airflow-providers-exasol            4.4.1
apache-airflow-providers-facebook          3.4.0
apache-airflow-providers-ftp               3.7.0
apache-airflow-providers-github            2.5.1
apache-airflow-providers-google            10.13.1
apache-airflow-providers-grpc              3.4.1
apache-airflow-providers-hashicorp         3.6.1
apache-airflow-providers-http              4.8.0
apache-airflow-providers-imap              3.5.0
apache-airflow-providers-influxdb          2.4.0
apache-airflow-providers-jdbc              4.2.1
apache-airflow-providers-jenkins           3.5.1
apache-airflow-providers-microsoft-azure   8.5.1
apache-airflow-providers-microsoft-mssql   3.6.0
apache-airflow-providers-microsoft-psrp    2.5.0
apache-airflow-providers-microsoft-winrm   3.4.0
apache-airflow-providers-mongo             3.5.0
apache-airflow-providers-mysql             5.5.1
apache-airflow-providers-neo4j             3.5.0
apache-airflow-providers-odbc              4.4.0
apache-airflow-providers-openai            1.1.0
apache-airflow-providers-openfaas          3.4.0
apache-airflow-providers-openlineage       1.4.0
apache-airflow-providers-opensearch        1.1.1
apache-airflow-providers-opsgenie          5.5.0
apache-airflow-providers-oracle            3.9.1
apache-airflow-providers-pagerduty         3.6.0
apache-airflow-providers-papermill         3.6.0
apache-airflow-providers-pgvector          1.1.0
apache-airflow-providers-pinecone          1.1.1
apache-airflow-providers-postgres          5.10.0
apache-airflow-providers-presto            5.4.0
apache-airflow-providers-redis             3.6.0
apache-airflow-providers-salesforce        5.6.1
apache-airflow-providers-samba             4.5.0
apache-airflow-providers-segment           3.4.0
apache-airflow-providers-sendgrid          3.4.0
apache-airflow-providers-sftp              4.8.1
apache-airflow-providers-singularity       3.4.0
apache-airflow-providers-slack             8.5.1
apache-airflow-providers-smtp              1.6.0
apache-airflow-providers-snowflake         5.2.1
apache-airflow-providers-sqlite            3.7.0
apache-airflow-providers-ssh               3.10.0
apache-airflow-providers-tableau           4.4.0
apache-airflow-providers-tabular           1.4.1
apache-airflow-providers-telegram          4.3.0
apache-airflow-providers-trino             5.6.0
apache-airflow-providers-vertica           3.7.0
apache-airflow-providers-weaviate          1.3.0
apache-airflow-providers-yandex            3.7.1
apache-airflow-providers-zendesk           4.6.0
apache-beam                                2.53.0
apispec[yaml]                              6.4.0
appnope                                    0.1.3
apprise                                    1.7.1
argcomplete                                3.2.1
asana                                      3.2.2
asgiref                                    3.7.2
asn1crypto                                 1.5.1
asttokens                                  2.4.1
atlasclient                                1.0.0
atlassian-python-api                       3.41.6
attrs                                      23.2.0
authlib                                    1.3.0
azure-batch                                14.1.0
azure-common                               1.1.28
azure-core                                 1.29.6
azure-cosmos                               4.5.1
azure-datalake-store                       0.0.53
azure-identity                             1.15.0
azure-keyvault-secrets                     4.7.0
azure-kusto-data                           4.3.1
azure-mgmt-containerinstance               10.1.0
azure-mgmt-containerregistry               10.3.0
azure-mgmt-core                            1.4.0
azure-mgmt-cosmosdb                        9.4.0
azure-mgmt-datafactory                     4.0.0
azure-mgmt-datalake-nspkg                  3.0.1
azure-mgmt-datalake-store                  0.5.0
azure-mgmt-nspkg                           3.0.2
azure-mgmt-resource                        23.0.1
azure-mgmt-storage                         21.1.0
azure-nspkg                                3.0.2
azure-servicebus                           7.11.4
azure-storage-blob                         12.19.0
azure-storage-file-datalake                12.14.0
azure-storage-file-share                   12.15.0
azure-synapse-artifacts                    0.18.0
azure-synapse-spark                        0.7.0
babel                                      2.14.0
backoff                                    2.2.1
bcrypt                                     4.1.2
beautifulsoup4                             4.12.2
billiard                                   4.2.0
bitarray                                   2.9.2
black                                      24.1a1
blinker                                    1.7.0
boto3                                      1.33.13
botocore                                   1.33.13
cachelib                                   0.10.2
cachetools                                 5.3.2
cassandra-driver                           3.29.0
cattrs                                     23.2.3
celery                                     5.3.6
certifi                                    2023.11.17
cffi                                       1.16.0
cgroupspy                                  0.2.2
chardet                                    5.2.0
charset-normalizer                         3.3.2
ciso8601                                   2.3.1
click                                      8.1.7
click-didyoumean                           0.3.0
click-plugins                              1.1.1
click-repl                                 0.3.0
clickclick                                 20.10.2
cloudant                                   2.15.0
cloudpickle                                2.2.1
cohere                                     4.44
colorama                                   0.4.6
colorlog                                   4.8.0
comm                                       0.2.1
configupdater                              3.2
confluent-kafka                            2.3.0
connexion[flask]                           2.14.2
crcmod                                     1.7
cron-descriptor                            1.4.0
croniter                                   2.0.1
cryptography                               41.0.7
curlify                                    2.2.1
databricks-sql-connector                   2.9.3
datadog                                    0.47.0
db-dtypes                                  1.2.0
debugpy                                    1.8.0
decorator                                  5.1.1
defusedxml                                 0.7.1
deprecated                                 1.2.14
dill                                       0.3.1.1
distlib                                    0.3.8
distro                                     1.9.0
dnspython                                  2.4.2
docker                                     7.0.0
docopt                                     0.6.2
docutils                                   0.20.1
elastic-transport                          8.11.0
elasticsearch                              8.11.1
email-validator                            1.3.1
entrypoints                                0.4
et-xmlfile                                 1.1.0
eventlet                                   0.34.3
executing                                  2.0.1
facebook-business                          18.0.5
fastavro                                   1.9.3
fasteners                                  0.19
fastjsonschema                             2.19.1
filelock                                   3.13.1
flask                                      2.2.5
flask-appbuilder[oauth]                    4.3.10
flask-babel                                2.0.0
flask-bcrypt                               1.0.1
flask-caching                              2.0.1
flask-jwt-extended                         4.6.0
flask-limiter                              3.5.0
flask-login                                0.6.3
flask-session                              0.5.0
flask-sqlalchemy                           2.5.1
flask-wtf                                  1.2.1
flower                                     2.0.1
frozenlist                                 1.4.1
fsspec                                     2023.12.2
future                                     0.18.3
gcloud-aio-auth                            4.2.3
gcloud-aio-bigquery                        7.0.0
gcloud-aio-storage                         9.0.0
gcsfs                                      2023.12.2.post1
geomet                                     0.2.1.post1
gevent                                     23.9.1
google-ads                                 22.1.0
google-api-core[grpc]                      2.15.0
google-api-python-client                   2.113.0
google-auth                                2.26.2
google-auth-httplib2                       0.2.0
google-auth-oauthlib                       1.2.0
google-cloud-aiplatform                    1.39.0
google-cloud-appengine-logging             1.4.0
google-cloud-audit-log                     0.2.5
google-cloud-automl                        2.12.0
google-cloud-batch                         0.17.7
google-cloud-bigquery                      3.16.0
google-cloud-bigquery-datatransfer         3.13.0
google-cloud-bigquery-storage              2.24.0
google-cloud-bigtable                      2.22.0
google-cloud-build                         3.22.0
google-cloud-compute                       1.15.0
google-cloud-container                     2.37.0
google-cloud-core                          2.4.1
google-cloud-datacatalog                   3.17.2
google-cloud-dataflow-client               0.8.6
google-cloud-dataform                      0.5.5
google-cloud-dataplex                      1.11.0
google-cloud-dataproc                      5.8.0
google-cloud-dataproc-metastore            1.14.0
google-cloud-dlp                           3.14.0
google-cloud-kms                           2.20.0
google-cloud-language                      2.12.0
google-cloud-logging                       3.9.0
google-cloud-memcache                      1.8.0
google-cloud-monitoring                    2.18.0
google-cloud-orchestration-airflow         1.10.0
google-cloud-os-login                      2.13.0
google-cloud-pubsub                        2.19.0
google-cloud-redis                         2.14.0
google-cloud-resource-manager              1.11.0
google-cloud-run                           0.10.1
google-cloud-secret-manager                2.17.0
google-cloud-spanner                       3.41.0
google-cloud-speech                        2.23.0
google-cloud-storage                       2.14.0
google-cloud-storage-transfer              1.10.0
google-cloud-tasks                         2.15.0
google-cloud-texttospeech                  2.15.1
google-cloud-translate                     3.14.0
google-cloud-videointelligence             2.12.0
google-cloud-vision                        3.5.0
google-cloud-workflows                     1.13.0
google-crc32c                              1.5.0
google-re2                                 1.1
google-resumable-media                     2.7.0
googleapis-common-protos[grpc]             1.62.0
graphviz                                   0.20.1
greenlet                                   3.0.3
grpc-google-iam-v1                         0.13.0
grpcio                                     1.60.0
grpcio-gcp                                 0.2.2
grpcio-status                              1.60.0
gssapi                                     1.8.3
gunicorn                                   21.2.0
h11                                        0.14.0
hdfs[avro,dataframe,kerberos]              2.7.3
hmsclient                                  0.1.1
httpcore                                   1.0.2
httplib2                                   0.22.0
httpx                                      0.25.2
humanize                                   4.9.0
hvac                                       2.1.0
idna                                       3.6
ijson                                      3.2.3
importlib-metadata                         6.11.0
importlib-resources                        6.1.1
impyla                                     0.19.0
inflection                                 0.5.1
influxdb-client                            1.39.0
ipykernel                                  6.28.0
ipython                                    8.20.0
isodate                                    0.6.1
itsdangerous                               2.1.2
jaydebeapi                                 1.2.3
jedi                                       0.19.1
jinja2                                     3.1.3
jmespath                                   0.10.0
jpype1                                     1.5.0
js2py                                      0.74
json-merge-patch                           0.2
jsonpath-ng                                1.6.1
jsonpickle                                 3.0.2
jsonschema                                 4.20.0
jsonschema-specifications                  2023.12.1
jupyter-client                             8.6.0
jupyter-core                               5.7.1
kombu                                      5.3.5
krb5                                       0.5.1
kubernetes                                 23.6.0
kubernetes-asyncio                         24.2.3
kylinpy                                    2.8.4
lazy-object-proxy                          1.10.0
ldap3                                      2.9.1
limits                                     3.7.0
linkify-it-py                              2.0.2
lockfile                                   0.12.2
looker-sdk                                 23.20.1
lxml                                       5.1.0
lz4                                        4.3.3
mako                                       1.3.0
markdown                                   3.5.2
markdown-it-py                             3.0.0
markupsafe                                 2.1.3
marshmallow                                3.20.2
marshmallow-oneofschema                    3.0.1
marshmallow-sqlalchemy                     0.26.1
matplotlib-inline                          0.1.6
mdit-py-plugins                            0.4.0
mdurl                                      0.1.2
more-itertools                             10.2.0
msal                                       1.26.0
msal-extensions                            1.1.0
msrest                                     0.7.1
msrestazure                                0.6.4
multi-key-dict                             2.0.3
multidict                                  6.0.4
mypy-extensions                            1.0.0
mysql-connector-python                     8.3.0
mysqlclient                                2.2.1
nbclient                                   0.9.0
nbformat                                   5.9.2
neo4j                                      5.16.0
nest-asyncio                               1.5.9
numpy                                      1.24.4
oauthlib                                   3.2.2
objsize                                    0.6.1
openai[datalib]                            1.7.2
openlineage-integration-common             1.7.0
openlineage-python                         1.7.0
openlineage-sql                            1.7.0
openpyxl                                   3.1.2
opensearch-py                              2.4.2
opentelemetry-api                          1.22.0
opentelemetry-exporter-otlp                1.22.0
opentelemetry-exporter-otlp-proto-common   1.22.0
opentelemetry-exporter-otlp-proto-grpc     1.22.0
opentelemetry-exporter-otlp-proto-http     1.22.0
opentelemetry-exporter-prometheus          0.43b0
opentelemetry-proto                        1.22.0
opentelemetry-sdk                          1.22.0
opentelemetry-semantic-conventions         0.43b0
opsgenie-sdk                               2.1.5
oracledb                                   2.0.1
ordered-set                                4.1.0
orjson                                     3.9.10
oss2                                       2.18.4
packaging                                  23.2
pandas                                     2.1.4
pandas-gbq                                 0.20.0
pandas-stubs                               2.0.2.230605
papermill[all]                             2.5.0
paramiko                                   3.4.0
parso                                      0.8.3
pathspec                                   0.12.1
pbr                                        6.0.0
pdpyras                                    5.2.0
pendulum                                   2.1.2
pexpect                                    4.9.0
pgvector                                   0.2.4
pinecone-client                            3.0.0
pinotdb                                    0.4.8
platformdirs                               3.11.0
pluggy                                     1.3.0
ply                                        3.11
plyvel                                     1.5.1
portalocker                                2.8.2
presto-python-client                       0.8.4
prison                                     0.2.1
prometheus-client                          0.19.0
prompt-toolkit                             3.0.43
proto-plus                                 1.23.0
protobuf                                   4.25.2
psutil                                     5.9.7
psycopg2-binary                            2.9.9
ptyprocess                                 0.7.0
pure-eval                                  0.2.2
pure-sasl                                  0.6.2
py4j                                       0.10.9.7
pyarrow                                    14.0.2
pyarrow-hotfix                             0.6
pyasn1                                     0.5.1
pyasn1-modules                             0.3.0
pycountry                                  23.12.11
pycparser                                  2.21
pycryptodome                               3.20.0
pydantic                                   2.5.3
pydantic-core                              2.14.6
pydata-google-auth                         1.8.2
pydot                                      1.4.2
pydruid                                    0.6.6
pyexasol                                   0.25.2
pygithub                                   2.1.1
pygments                                   2.17.2
pyhive[hive-pure-sasl]                     0.7.0
pyjsparser                                 2.7.1
pyjwt[crypto]                              2.8.0
pykerberos                                 1.2.4
pymongo                                    4.6.1
pymssql                                    2.2.11
pynacl                                     1.5.0
pyodbc                                     5.0.1
pyopenssl                                  23.3.0
pyparsing                                  3.1.1
pypsrp                                     0.8.1
pyspark                                    3.5.0
pyspnego[kerberos]                         0.10.2
python-arango                              7.9.0
python-daemon                              3.0.1
python-dateutil                            2.8.2
python-dotenv                              1.0.0
python-http-client                         3.3.7
python-jenkins                             1.8.2
python-ldap                                3.4.4
python-nvd3                                0.15.0
python-slugify                             8.0.1
python-telegram-bot                        20.7
python3-saml                               1.16.0
pytz                                       2023.3.post1
pytzdata                                   2020.1
pywinrm                                    0.4.3
pyyaml                                     6.0.1
pyzmq                                      25.1.2
reactivex                                  4.0.4
redis                                      4.6.0
redshift-connector                         2.0.918
referencing                                0.32.1
regex                                      2023.12.25
requests                                   2.31.0
requests-file                              1.5.1
requests-kerberos                          0.14.0
requests-ntlm                              1.2.0
requests-oauthlib                          1.3.1
requests-toolbelt                          1.0.0
rfc3339-validator                          0.1.4
rich                                       13.7.0
rich-argparse                              1.4.0
rpds-py                                    0.17.1
rsa                                        4.9
s3fs                                       2023.12.2
s3transfer                                 0.8.2
scramp                                     1.4.4
scrapbook[all]                             0.5.0
sendgrid                                   6.11.0
sentry-sdk                                 1.39.2
setproctitle                               1.3.3
setuptools                                 66.1.1
shapely                                    2.0.2
simple-salesforce                          1.12.5
six                                        1.16.0
slack-sdk                                  3.26.2
smbprotocol                                1.12.0
sniffio                                    1.3.0
snowflake-connector-python                 3.6.0
snowflake-sqlalchemy                       1.5.1
sortedcontainers                           2.4.0
soupsieve                                  2.5
spython                                    0.3.13
sqlalchemy                                 1.4.51
sqlalchemy-bigquery                        1.9.0
sqlalchemy-drill                           1.1.4
sqlalchemy-jsonfield                       1.0.2
sqlalchemy-redshift                        0.8.14
sqlalchemy-spanner                         1.6.2
sqlalchemy-utils                           0.41.1
sqlparse                                   0.4.4
sshtunnel                                  0.4.0
stack-data                                 0.6.3
starkbank-ecdsa                            2.2.0
statsd                                     4.0.1
tableauserverclient                        0.29
tabulate                                   0.9.0
tenacity                                   8.2.3
termcolor                                  2.4.0
text-unidecode                             1.3
thrift                                     0.16.0
thrift-sasl                                0.4.3
tomlkit                                    0.12.3
tornado                                    6.4
tqdm                                       4.66.1
traitlets                                  5.14.1
trino                                      0.327.0
types-pytz                                 2023.3.1.1
typing-extensions                          4.9.0
tzdata                                     2023.4
tzlocal                                    5.2
uc-micro-py                                1.0.2
unicodecsv                                 0.14.1
universal-pathlib                          0.1.4
uritemplate                                4.1.1
urllib3                                    2.0.7
validators                                 0.22.0
vertica-python                             1.3.8
vine                                       5.1.0
virtualenv                                 20.25.0
watchtower                                 3.0.1
wcwidth                                    0.2.13
weaviate-client                            3.26.1
websocket-client                           1.7.0
werkzeug                                   2.2.3
wrapt                                      1.16.0
wtforms                                    3.1.2
xmlsec                                     1.3.13
xmltodict                                  0.13.0
yandexcloud                                0.253.0
yarl                                       1.9.4
zeep                                       4.2.1
zenpy                                      2.0.45
zipp                                       3.17.0
zope-event                                 5.0
zope-interface                             6.1
zstandard                                  0.22.0

Successfully installed environment!

[tdejager]

It's broken again on main because of #178 and I get to a point where I cannot build for the same reason as mentioned in that thread.