search

apache / incubator-wayang

Apache Wayang(incubating) is the first cross-platform data processing system.
https://wayang.incubator.apache.org/
Apache License 2.0
189 stars 81 forks source link

Move JavaCSVTableSource operator from sql-api to the Java platform #482

Open zkaoudi opened 19 hours ago

zkaoudi commented 19 hours ago

There is a Java csv source operator inside the wayang sql api: JavaCSVTableSource.

We should move it to the wayang-platforms/wayang-java module, specifically here and rename it to JavaCSVFileSource because it is reading from a file and not a table in the database.

kbeedkar commented 19 hours ago

Makes sense, the reason to call it JavaCSVTableSource was that it expects the csv file to adhere to a certain format. Specifically, comma separated colname:type header row. This is required to create an appropriate schema to query against.