search

jpmml / jpmml-evaluator-spark

PMML evaluator library for the Apache Spark cluster computing system (http://spark.apache.org/)
GNU Affero General Public License v3.0
94 stars 43 forks source link

when i only use jpmml-evaluator-spark, it will incur an exception #38

Closed zdkzdk closed 2 years ago

zdkzdk commented 4 years ago

when i only use jpmml-evaluator-spark，it will incur an exception.i must explicitly use the other 2 dependencies. --------------------error!!!----------------

org.jpmml jpmml-evaluator-spark 1.2.2

-------------------correct, i have to use 2 extra dependencies!!!----------------------

org.jpmml jpmml-evaluator-spark 1.2.2 
    <dependency>
        <groupId>org.jpmml</groupId>
        <artifactId>pmml-evaluator</artifactId>
        <version>1.4.7</version>
    </dependency>
    <dependency>
        <groupId>org.jpmml</groupId>
        <artifactId>pmml-model</artifactId>
        <version>1.4.8</version>
    </dependency>
vruusmann commented 4 years ago

What's your Apache Spark version, how are you using the JPMML-Evaluator-Spark library (as part of Apache Maven build, or as a "soft dependency" using the --packages command-line option).

I checked the pom.xml, and it doesn't use any exclusions (that would cause some dependencies to be left out).

zdkzdk commented 4 years ago

spark2.2.0，Apache Maven build this is my pom,why i have to take 2 extra dependencies: pmml-evaluator and pmml-model

    <dependency>
        <groupId>org.apache.spark</groupId>
        <artifactId>spark-mllib_${scala_spark.version}</artifactId>
        <version>${spark.version}</version>
        <scope>${provided.scope}</scope>
        <exclusions>
            <exclusion>
                <groupId>org.jpmml</groupId>
                <artifactId>pmml-model</artifactId>
            </exclusion>
        </exclusions>
    </dependency>

    <!--PMML-Spark-->
    <dependency>
        <groupId>org.jpmml</groupId>
        <artifactId>jpmml-evaluator-spark</artifactId>
        <version>1.2.2</version>
    </dependency>
    <dependency>
        <groupId>org.jpmml</groupId>
        <artifactId>pmml-evaluator</artifactId>
        <version>1.4.7</version>
    </dependency>
    <dependency>
        <groupId>org.jpmml</groupId>
        <artifactId>pmml-model</artifactId>
        <version>1.4.8</version>
    </dependency>

another problem,my company is a bank that don't allow networking,so how do I use maven shade,Can shade be used without maven? Thank you first ~~~

vruusmann commented 2 years ago

This issue has been definitely fixed by now.