Closed bollwyvl closed 4 years ago
Here's the CI fail from the above feedstock. The clobber warnings were distracting me from the the actual fail:
Traceback (most recent call last):
File "/home/conda/feedstock_root/build_artifacts/dagster_1592055137801/test_tmp/run_test.py", line 2, in <module>
import dagster_gcp
File "/home/conda/feedstock_root/build_artifacts/dagster_1592055137801/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehol/lib/python3.7/site-packages/dagster_gcp/__init__.py", line 3, in <module>
from .bigquery.resources import bigquery_resource
File "/home/conda/feedstock_root/build_artifacts/dagster_1592055137801/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehol/lib/python3.7/site-packages/dagster_gcp/bigquery/resources.py", line 1, in <module>
from google.cloud import bigquery
File "/home/conda/feedstock_root/build_artifacts/dagster_1592055137801/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehol/lib/python3.7/site-packages/google/cloud/bigquery/__init__.py", line 35, in <module>
from google.cloud.bigquery.client import Client
File "/home/conda/feedstock_root/build_artifacts/dagster_1592055137801/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehol/lib/python3.7/site-packages/google/cloud/bigquery/client.py", line 61, in <module>
from google.cloud.bigquery.dataset import Dataset
File "/home/conda/feedstock_root/build_artifacts/dagster_1592055137801/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehol/lib/python3.7/site-packages/google/cloud/bigquery/dataset.py", line 26, in <module>
from google.cloud.bigquery.table import TableReference
File "/home/conda/feedstock_root/build_artifacts/dagster_1592055137801/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehol/lib/python3.7/site-packages/google/cloud/bigquery/table.py", line 29, in <module>
from google.cloud import bigquery_storage_v1beta1
File "/home/conda/feedstock_root/build_artifacts/dagster_1592055137801/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehol/lib/python3.7/site-packages/google/cloud/bigquery_storage_v1beta1/__init__.py", line 26, in <module>
from google.cloud.bigquery_storage_v1beta1 import client
File "/home/conda/feedstock_root/build_artifacts/dagster_1592055137801/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehol/lib/python3.7/site-packages/google/cloud/bigquery_storage_v1beta1/client.py", line 27, in <module>
from google.cloud.bigquery_storage_v1beta1.gapic import big_query_storage_client # noqa
File "/home/conda/feedstock_root/build_artifacts/dagster_1592055137801/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehol/lib/python3.7/site-packages/google/cloud/bigquery_storage_v1beta1/gapic/big_query_storage_client.py", line 49, in <module>
class BigQueryStorageClient(object):
File "/home/conda/feedstock_root/build_artifacts/dagster_1592055137801/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehol/lib/python3.7/site-packages/google/cloud/bigquery_storage_v1beta1/gapic/big_query_storage_client.py", line 205, in BigQueryStorageClient
retry=google.api_core.gapic_v1.method.DEFAULT,
AttributeError: module 'google.api_core' has no attribute 'gapic_v1'
this is even more troubling...
Indeed, the upstream has the module trying to be imported: https://github.com/googleapis/python-api-core/blob/v1.20.0/google/api_core/gapic_v1/method.py#L27
I'm also seeing ClobberWarning: Conda was asked to clobber an existing path.
...
source path: /root/.conda/pkgs/google-api-core-1.20.0-py37hc8dfbb8_0/lib/python3.7/site-packages/urllib3/util/timeout.py
target path: /tmp/conda-bld/nexuscli_1592343363544/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_place/lib/python3.7/site-packages/urllib3/util/timeout.py
so it looks like it's packaging urllib3
instead of relying on conda to bring it in
Over on https://github.com/conda-forge/dagster-feedstock/pull/39, i'm seeing a lot of ClobberWarnings when trying to install 1.20.0. File size checks out, as well, with the previous versions being ~83kb and the new package 2.8mb.
Would request the current 1.20.0 be marked broken, will look into a fix (but not particularly interested in co-maintaining).
Here are some of the lines
...it continues