search

microsoft / azuredatastudio

Azure Data Studio is a data management and development tool with connectivity to popular cloud and on-premises databases. Azure Data Studio supports Windows, macOS, and Linux, with immediate capability to connect to Azure SQL and SQL Server. Browse the extension library for more database support options including MySQL, PostgreSQL, and MongoDB.
https://learn.microsoft.com/sql/azure-data-studio
MIT License
7.59k stars 908 forks source link

Official Support for Fabric Lakehouse SQL Endpoints #25272

Open VitalyMCT opened 10 months ago

VitalyMCT commented 10 months ago

Is your feature request related to a problem? Please describe. Can you please clarify the level of support for this database platform within the SQL Project extension?

The Fabric Warehouse support is officially GA SQL Projects support for Warehouse in Microsoft Fabric.

The platform selection in the extension also lists it specifically:

image

The situation around the Lakehouse SQL Endpoint on the other hand is a little unclear. This technology is similar to Warehouses, however, some differences can break the projects. Some of these differences are explained at SQL analytics endpoint of the Lakehouse vs. Synapse Data Warehouse

Describe the solution or feature you'd like Official GA support for Fabric Lakehouse SQL Endpoints

Describe alternatives you've considered N/A

Additional context N/A

VitalyMCT commented 9 months ago

@kisantia Can you please provide some feedback around this item? We are trying to figure out the appropriate SDLC to use, given the supportability provided within the Fabric ecosystem. Thanks.

kisantia commented 9 months ago

@ssreerama @chlafreniere @dzsquared can you please take a look at this issue?

dzsquared commented 9 months ago

@VitalyMCT - thanks for bringing this up! The current tooling support for lakehouses is focused on Spark and the VS Code extension - https://learn.microsoft.com/en-us/fabric/data-engineering/explore-lakehouse-with-vs-code

The best way to get better SQL projects support for lakehouses on the Fabric team's radar is through the ideas site: https://ideas.fabric.microsoft.com/?forum=f2a1a698-503e-ed11-bba2-000d3a8b12b6&category=a0a75d51-513e-ed11-bba2-000d3a8b12b6

VitalyMCT commented 9 months ago

@dzsquared To clarify, as you saying the SQL Server Database Projects extension does not support Lakehouses?

If so, which specific elements are not expected to work?

Experimentally we are seeing similar level of support for Lakehouse SQL Endpoints as for Warehouse SQL Endpoints. I.e. the extension connects to Lakehouses and consumes metadata from there as well as it does for Warehouses.