dibbhatt / kafka-spark-consumer

High Performance Kafka Connector for Spark Streaming.Supports Multi Topic Fetch, Kafka Security. Reliable offset management in Zookeeper. No Data-loss. No dependency on HDFS and WAL. In-built PID rate controller. Support Message Handler . Offset Lag checker.
Apache License 2.0
635 stars 318 forks source link

Can a higher version of Spark be supported? Spark 3.2.0 for example. #72

Closed joao-parana closed 2 years ago

dibbhatt commented 2 years ago

Yes, higher version of Spark will work. You need to change the pom file to include correct spark version