search

vespa-engine / vespa

AI + Data, online. https://vespa.ai
https://vespa.ai
Apache License 2.0
5.47k stars 584 forks source link

Build a Vespa connector for Sqoop #5020

Open frodelu opened 6 years ago

frodelu commented 6 years ago

In order to make it easier to import/export data between Vespa and Hadoop/HDFS, should we consider writing a Vespa connector for Apache Sqoop? It could allow an even easier way to move data between the two than using the current feeder for Hadoop even with a nice UI: http://gethue.com/move-data-in-out-your-hadoop-cluster-with-the-sqoop/.

FYI: @lesters and @bratseth

frodelu commented 6 years ago

Theoretically, if we have a connector that supports both "from" and "to", this could also be a straight-forward way to move data between Vespa instances?

frodelu commented 6 years ago

Candidate for summer intern project 2018?