search

databricks / sbt-spark-package

Sbt plugin for Spark packages
Apache License 2.0
151 stars 32 forks source link

do not provide structured streaming for kafka #37

Closed thomasdziedzic closed 6 years ago

thomasdziedzic commented 7 years ago

Following the guide at: https://spark.apache.org/docs/latest/structured-streaming-kafka-integration.html

When I add the spark-sql-kafka-0-10 as a component, it gets automatically provided.

When I add the package as a depdendency, I get the error that "Please add any Spark dependencies by supplying the sparkVersion and sparkComponents."

thomasdziedzic commented 6 years ago

Unfortunately, it looks like this project is dead so I'm going to close my PR.