search

microsoft / dbt-fabric

MIT License
79 stars 28 forks source link

Python models? #190

Closed joegood closed 5 months ago

joegood commented 5 months ago

Are there any plans to support Python models with this adapter?

When I try to use one now, I get the following error: Materialization "materialization_table_fabric" only supports languages ['sql']; got "python"

prdpsvs commented 5 months ago

@joegood , no, we do not plan to support python models because DW adapter supports T-SQL surface area.

joegood commented 5 months ago

What? Do you know what the Python models are used for? This means you're blocking the entire Python AI/ML module base on MS servers.

lehmus commented 1 month ago

Python is "the second language of DBT" and has been available for BigQuery, Databricks and Snowflake for two years. Why would MS Fabric leave it out? https://www.getdbt.com/blog/introducing-support-for-python

How would one use T-SQL to create ML training and evaluation workloads? We use Python for many tasks, including data engineering, and would like to manage the Python workloads with DBT as well. I have understood that DBT will be integrated with Fabric increasingly in the future, so I would expect Fabric to support basic functionalities of DBT like Python models.

EDIT: I've just heard that this version of the Fabric DBT plugin supports Data Warehouses only. I guess that lack of Python support makes sense in that case since Warehouse tables can only be written to using T-SQL (which I also just learned...).