microsoft / semantic-link-labs

Early access to new features for Microsoft Fabric's Semantic Link.
MIT License
178 stars 40 forks source link

Incorrect column and Data order by run_model_bpa export and Discrepancy in Results Between run_model_bpa and run_model_bpa_bulk Functions #288

Open Jai-Prakash-HU opened 5 days ago

Jai-Prakash-HU commented 5 days ago

Discrepancy in Data Order and Results Between run_model_bpa and run_model_bpa_bulk Functions Dear Microsoft Support Team,

I am encountering an issue with the run_model_bpa function not saving data in the correct order in the modelbparesults table. Below are the details of the scenarios I tested:

Initial Scenario: The table modelbparesults was already present in the lakehouse. Running run_model_bpa did not save the results in the proper order.

Dropping and Recreating the Table: I dropped the modelbparesults table and re-ran the run_model_bpa function. However, it still did not save the results in the correct order.

Using run_model_bpa_bulk: When I ran the run_model_bpa_bulk function, it successfully saved the data in the correct order.

Discrepancy in Results Count: In a simple test dataset, run_model_bpa_bulk returned 8 rows, while run_model_bpa returned only 4 rows.

Request: For our automation process, we rely on both run_model_bpa and run_model_bpa_bulk functions operating consistently on the same lakehouse table (modelbparesults). Please ensure both functions:

Save data in the same order. Return consistent and accurate results. Attached is a screenshot highlighting the issue for reference.

Image

In the below screenshot first 4 rows are by run_model_bpa and last 8 rows by run_model_bpa_bulk

Image

m-kovalsky commented 5 days ago

Made a fix for the next release