databricks-industry-solutions / hls-payer-mrf-sparkstreaming

Spark Structured Streaming for Payer MRF use case
Other
14 stars 6 forks source link

Hotfix s3 fs #29

Closed zavoraad closed 1 year ago

zavoraad commented 1 year ago

Updating how the Filesystem is created in S3. Add option param below to invoke this.

fixes #27

.option("filesystem", "s3a")