cloudera-labs / envelope

Build configuration-driven ETL pipelines on Apache Spark
Apache License 2.0
157 stars 89 forks source link

Add Solr storage system #3

Open jeremybeard opened 8 years ago

kamir commented 5 years ago

Using Envelope also for indexing of records/files/events in Solr would be interesting.

Has this idea already been discussed?

Would that functionality be redundant with the CrunchIndexerTool / MRIndexerTool or LillyBatchIndexer?

Even with such a redundancy, to me it looks like a Solr-connector would be a natural fit to this tool.