[bigquery] Installing with bigquery extra does not install all needed dependencies - Githubissues

fal-ai / dbt-fal

do more with dbt. dbt-fal helps you run Python alongside dbt, so you can send Slack alerts, detect anomalies and build machine learning models.

https://fal.ai/dbt-fal

Apache License 2.0

853 stars 72 forks source link

[bigquery] Installing with bigquery extra does not install all needed dependencies #772

Open chamini2 opened 1 year ago

chamini2 commented 1 year ago

Describe the bug

Using versions

dbt-core >= 1.3.2
dbt-bigquery >= 1.4
fal[bigquery]==0.8

A user is getting an error for the db-dtypes package not being available.

Even though we do install the pandas extra

https://github.com/fal-ai/fal/blob/5ae3e2a46b1199d0deb9dabefd9766fdf261e770/projects/fal/pyproject.toml#L48

package code:

https://github.com/googleapis/python-bigquery/blob/204779c57e706c002ababff72f8e45f1e376b960/setup.py#L65-L69

    "pandas": [
        "pandas>=1.1.0",
        pyarrow_dependency,
        "db-dtypes>=0.3.0,<2.0.0dev",
    ],

We must reproduce this and fix accordingly.

Your environment

OS: GH action
Paste the following commands output: in image
Adapter being used: bigquery

Expected behavior No missing module error.