search

linkedin / isolation-forest

A Spark/Scala implementation of the isolation forest unsupervised outlier detection algorithm with support for exporting in ONNX format.
Other
223 stars 47 forks source link

Publish artifact for spark 3.0.0 #22

Closed hoffrocket closed 3 years ago

hoffrocket commented 3 years ago

Hello,

Would it be possible for you to publish the artifacts compiled against spark 3?

I've built locally and it seems build without any errors using this command line: ./gradlew test -PsparkVersion=3.0.0 -PscalaVersion=2.12.11

Although I haven't tested if it works in practice.

jverbus commented 3 years ago

@hoffrocket, I created a PR to build and publish artifacts using Spark v3.0.0.

https://github.com/linkedin/isolation-forest/pull/23

It would be good to confirm these artifacts work on a Spark 3 cluster. Have you successfully verified this using the ones you build manually?

Thanks, James

hoffrocket commented 3 years ago

Yes, we're actively fitting a model on Spark 3 without any issues. Thanks!

jverbus commented 3 years ago

isolation-forest v1.0.1 artifacts built with Spark 3.0.0 and Scala 2.12.11 are now published to Bintray and Maven Central.