Azure-Samples / cdm-azure-data-services-integration

Tutorials and sample code for integrating CDM folders with Azure Data Services
MIT License
70 stars 46 forks source link

Saving new files in CDM via Databricks, save seems to overwrite the old files #14

Open WolakT opened 5 years ago

WolakT commented 5 years ago

Please provide us with the following information:

This issue is for a: (mark with an x)

- [ ] bug report -> please search issues before submitting
- [ ] feature request
- [x ] documentation issue or request
- [ ] regression (a behavior that used to work and stopped in a new release)

Minimal steps to reproduce

saving an arbitrary spark df to a CDM folder: '''(spark_df.write.format("com.microsoft.cdm") .option("entity", CDMentity ) .option("appId", appID) .option("appKey", appKey) .option("tenantId", tenantID) .option("cdmFolder", outputLocation) .option("cdmModelName", CDMmodelName) .save())'''

Any log messages given by the failure

the csv file in snapshot folder has been overwritten

Expected/desired behavior


Tried passing file name in save but without success.```