Azure-Samples / Synapse

Samples for Azure Synapse Analytics
MIT License
378 stars 350 forks source link

Synapse Intelligent Cache is not working #155

Open Kiran-G1 opened 2 years ago

Kiran-G1 commented 2 years ago

Env: --Spark 3.2 --Synapse-premium --Intelligent caching enabled.

Intelligent cache enabled image

Inital content of CSV file

image

read successfully

image

added more content later

image

the same result was shown even after running df1.take(100) several times instead of displaying the newly records added to it.

image

The issue was resolved after rerunning the spark.read again