I joined Google in the last year and have been working with big data tools for a while. Spark should be considered comparable to Flume. Also, Apache Flink should be on the same level, comparable to Flume. Both Spark and Flink are relatively high-level interfaces that will build DAGs from what are effectively macros. They provide db-like operations like joins, filters, etc.
I joined Google in the last year and have been working with big data tools for a while. Spark should be considered comparable to Flume. Also, Apache Flink should be on the same level, comparable to Flume. Both Spark and Flink are relatively high-level interfaces that will build DAGs from what are effectively macros. They provide db-like operations like joins, filters, etc.