MicrosoftLearning / mslearn-fabric

This repository hosts content related to Microsoft Fabric content on Microsoft Learn.
https://microsoftlearning.github.io/mslearn-fabric/
MIT License
147 stars 108 forks source link

data wrangler works with pyspark dataframes as well as pandas #147

Closed covlorin closed 1 day ago

covlorin commented 1 week ago

Module: Fabric

Lab/Demo: 08

Task: https://microsoftlearning.github.io/mslearn-fabric/Instructions/Labs/08-data-science-get-started.html#prepare-the-data

Step: Prepare the data

https://microsoftlearning.github.io/mslearn-fabric/Instructions/Labs/08-data-science-get-started.html#prepare-the-data

Description of issue Lab incorrectly states "To launch the Data Wrangler, you need to convert the data to a Pandas dataframe." In reality, data wrangler works with spark dataframe.

covlorin commented 1 week ago

However, I just realized the wrangler for spark is in preview, and the experience is slightly different. For example the "Create column from formula" is not available when using data wrangler on a spark dataframe.

So, the tutorial correct when considering only GA features, but will need to be revised in the future.