Replace copy noop spark job with data flow

Azure / Azure-Orbital-Analytics-Samples

Sample solution that demonstrates how to deploy and analyze spaceborne data using Azure Synapse Analytics

https://aka.ms/synapse-geospatial-analytics

MIT License

30 stars 24 forks source link

Replace copy noop spark job with data flow #62

Closed senthilkungumaraj closed 2 years ago

senthilkungumaraj commented 2 years ago

Replace copy noop spark job with data flow. This should unblock and serve to improve performance for the overall pipeline as it will avoid the use of file share mount in mssparkutils which is currently failing.