update spark 3.0.1 scala 2.12

USCDataScience / sparkler

Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.

http://irds.usc.edu/sparkler/

Apache License 2.0

410 stars 143 forks source link

update spark 3.0.1 scala 2.12 #191

Closed thammegowda closed 3 years ago

thammegowda commented 3 years ago

Closes #190 Build with tests passes on JDK14 on OSX

buggtb commented 3 years ago

I've merged these changes elsewhere due to it being quicker than rebasing. Works fine, had to update Jackson though which doesn't seem to get used in the tests but blows up if out of sync with Spark.