Create dataframe from list instead of RDD

opensearch-project / opensearch-spark

Spark Accelerator framework ; It enables secondary indices to remote data stores.

Apache License 2.0

14 stars 23 forks source link

Create dataframe from list instead of RDD #363

Open penghuo opened 4 months ago

penghuo commented 4 months ago

Description

Create dataframe from list instead of RDD, since EMR-S does not support create dataframe from RDD.

Issues Resolved

n/a

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license. For more information on following Developer Certificate of Origin and signing off your commits, please check here.

penghuo commented 4 months ago

To maintainer, Please don't merge this PR until we get confirmation that EMR-S upgrade is required.