liuhuanshuo
commented
2 years ago I am concerned about the issue of a new (https://github.com/jpmml/sklearn2pmml/issues/357)
I used pipeline_test._final_estimator.n_outputs_ = 1 instead of pipeline_test.target_fields = ["my_single_target"] as you replied in the post.
Then save pmml again and use JPMML-Evaluator-Python to read the model for prediction
Now, instead of prompting the previous error, it prints another error
---------------------------------------------------------------------------
Py4JJavaError Traceback (most recent call last)
~/.local/lib/python3.7/site-packages/jpmml_evaluator/__init__.py in evaluateAll(self, arguments_df, nan_as_missing)
128 try:
--> 129 result_records = self.backend.staticInvoke("org.jpmml.evaluator.python.PythonUtil", "evaluateAll", self.javaEvaluator, argument_records)
130 except Exception as e:
~/.local/lib/python3.7/site-packages/jpmml_evaluator/py4j.py in staticInvoke(self, className, methodName, *args)
24 javaMember = javaClass.__getattr__(methodName)
---> 25 return javaMember(*args)
26
~/.local/lib/python3.7/site-packages/py4j/java_gateway.py in __call__(self, *args)
1322 return_value = get_return_value(
-> 1323 answer, self.gateway_client, self.target_id, self.name)
1324
~/.local/lib/python3.7/site-packages/py4j/protocol.py in get_return_value(answer, gateway_client, target_id, name)
327 "An error occurred while calling {0}{1}{2}.\n".
--> 328 format(target_id, ".", name), value)
329 else:
Py4JJavaError: An error occurred while calling z:org.jpmml.evaluator.python.PythonUtil.evaluateAll.
: java.lang.IllegalArgumentException: 2.02-20-92
at org.jpmml.model.temporals.DateTimeUtil.parseDate(DateTimeUtil.java:21)
at org.jpmml.evaluator.TypeUtil.parse(TypeUtil.java:90)
at org.jpmml.evaluator.TypeUtil.parseOrCast(TypeUtil.java:66)
at org.jpmml.evaluator.ScalarValue.<init>(ScalarValue.java:33)
at org.jpmml.evaluator.DiscreteValue.<init>(DiscreteValue.java:30)
at org.jpmml.evaluator.OrdinalValue.<init>(OrdinalValue.java:38)
at org.jpmml.evaluator.OrdinalValue.create(OrdinalValue.java:122)
at org.jpmml.evaluator.FieldValue.create(FieldValue.java:364)
at org.jpmml.evaluator.FieldValue.cast(FieldValue.java:109)
at org.jpmml.evaluator.ExpressionUtil.evaluateTypedExpressionContainer(ExpressionUtil.java:72)
at org.jpmml.evaluator.ExpressionUtil.evaluate(ExpressionUtil.java:86)
at org.jpmml.evaluator.ModelEvaluationContext.resolve(ModelEvaluationContext.java:100)
at org.jpmml.evaluator.EvaluationContext.evaluate(EvaluationContext.java:94)
at org.jpmml.evaluator.ExpressionUtil.evaluateFieldRef(ExpressionUtil.java:226)
at org.jpmml.evaluator.ExpressionUtil.evaluateExpression(ExpressionUtil.java:143)
at org.jpmml.evaluator.ExpressionUtil.evaluate(ExpressionUtil.java:129)
at org.jpmml.evaluator.ExpressionUtil.evaluateApply(ExpressionUtil.java:405)
at org.jpmml.evaluator.ExpressionUtil.evaluateExpression(ExpressionUtil.java:167)
at org.jpmml.evaluator.ExpressionUtil.evaluate(ExpressionUtil.java:129)
at org.jpmml.evaluator.ExpressionUtil.evaluateExpressionContainer(ExpressionUtil.java:61)
at org.jpmml.evaluator.ExpressionUtil.evaluateTypedExpressionContainer(ExpressionUtil.java:66)
at org.jpmml.evaluator.ExpressionUtil.evaluate(ExpressionUtil.java:86)
at org.jpmml.evaluator.ModelEvaluationContext.resolve(ModelEvaluationContext.java:100)
at org.jpmml.evaluator.EvaluationContext.evaluate(EvaluationContext.java:94)
at org.jpmml.evaluator.ExpressionUtil.evaluateFieldRef(ExpressionUtil.java:226)
at org.jpmml.evaluator.ExpressionUtil.evaluateExpression(ExpressionUtil.java:143)
at org.jpmml.evaluator.ExpressionUtil.evaluate(ExpressionUtil.java:129)
at org.jpmml.evaluator.ExpressionUtil.evaluateApply(ExpressionUtil.java:405)
at org.jpmml.evaluator.ExpressionUtil.evaluateExpression(ExpressionUtil.java:167)
at org.jpmml.evaluator.ExpressionUtil.evaluate(ExpressionUtil.java:129)
at org.jpmml.evaluator.ExpressionUtil.evaluateApply(ExpressionUtil.java:345)
at org.jpmml.evaluator.ExpressionUtil.evaluateExpression(ExpressionUtil.java:167)
at org.jpmml.evaluator.ExpressionUtil.evaluate(ExpressionUtil.java:129)
at org.jpmml.evaluator.ExpressionUtil.evaluateExpressionContainer(ExpressionUtil.java:61)
at org.jpmml.evaluator.ExpressionUtil.evaluateTypedExpressionContainer(ExpressionUtil.java:66)
at org.jpmml.evaluator.ExpressionUtil.evaluate(ExpressionUtil.java:86)
at org.jpmml.evaluator.ModelEvaluationContext.resolve(ModelEvaluationContext.java:100)
at org.jpmml.evaluator.EvaluationContext.evaluate(EvaluationContext.java:94)
at org.jpmml.evaluator.ModelEvaluationContext.resolve(ModelEvaluationContext.java:142)
at org.jpmml.evaluator.EvaluationContext.evaluate(EvaluationContext.java:94)
at org.jpmml.evaluator.PredicateUtil.evaluateSimplePredicate(PredicateUtil.java:101)
at org.jpmml.evaluator.PredicateUtil.evaluatePredicate(PredicateUtil.java:73)
at org.jpmml.evaluator.PredicateUtil.evaluate(PredicateUtil.java:63)
at org.jpmml.evaluator.PredicateUtil.evaluatePredicateContainer(PredicateUtil.java:53)
at org.jpmml.evaluator.tree.SimpleTreeModelEvaluator.evaluateTree(SimpleTreeModelEvaluator.java:122)
at org.jpmml.evaluator.tree.SimpleTreeModelEvaluator.evaluateAny(SimpleTreeModelEvaluator.java:90)
at org.jpmml.evaluator.tree.SimpleTreeModelEvaluator.evaluateRegression(SimpleTreeModelEvaluator.java:77)
at org.jpmml.evaluator.ModelEvaluator.evaluateInternal(ModelEvaluator.java:443)
at org.jpmml.evaluator.mining.MiningModelEvaluator.evaluateSegmentation(MiningModelEvaluator.java:595)
at org.jpmml.evaluator.mining.MiningModelEvaluator.evaluateRegression(MiningModelEvaluator.java:231)
at org.jpmml.evaluator.ModelEvaluator.evaluateInternal(ModelEvaluator.java:443)
at org.jpmml.evaluator.mining.MiningModelEvaluator.evaluateInternal(MiningModelEvaluator.java:224)
at org.jpmml.evaluator.mining.MiningModelEvaluator.evaluateSegmentation(MiningModelEvaluator.java:595)
at org.jpmml.evaluator.mining.MiningModelEvaluator.evaluateClassification(MiningModelEvaluator.java:303)
at org.jpmml.evaluator.ModelEvaluator.evaluateInternal(ModelEvaluator.java:446)
at org.jpmml.evaluator.mining.MiningModelEvaluator.evaluateInternal(MiningModelEvaluator.java:224)
at org.jpmml.evaluator.ModelEvaluator.evaluate(ModelEvaluator.java:300)
at org.jpmml.evaluator.python.PythonUtil.evaluate(PythonUtil.java:92)
at org.jpmml.evaluator.python.PythonUtil.evaluateAll(PythonUtil.java:58)
at org.jpmml.evaluator.python.PythonUtil.evaluateAll(PythonUtil.java:48)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:244)
at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:374)
at py4j.Gateway.invoke(Gateway.java:282)
at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132)
at py4j.commands.CallCommand.execute(CallCommand.java:79)
at py4j.GatewayConnection.run(GatewayConnection.java:238)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.time.format.DateTimeParseException: Text '2.02-20-92' could not be parsed at index 0
at java.time.format.DateTimeFormatter.parseResolved0(DateTimeFormatter.java:1949)
at java.time.format.DateTimeFormatter.parse(DateTimeFormatter.java:1851)
at java.time.LocalDate.parse(LocalDate.java:400)
at java.time.LocalDate.parse(LocalDate.java:385)
at org.jpmml.model.temporals.Date.parse(Date.java:86)
at org.jpmml.model.temporals.DateTimeUtil.parseDate(DateTimeUtil.java:19)
... 70 more
During handling of the above exception, another exception occurred:
JavaError Traceback (most recent call last)
<ipython-input-201-5a1bd5bd787f> in <module>
----> 1 evaluator.evaluateAll(x_oot_1)
~/.local/lib/python3.7/site-packages/jpmml_evaluator/__init__.py in evaluateAll(self, arguments_df, nan_as_missing)
129 result_records = self.backend.staticInvoke("org.jpmml.evaluator.python.PythonUtil", "evaluateAll", self.javaEvaluator, argument_records)
130 except Exception as e:
--> 131 raise self.backend.toJavaError(e)
132 result_records = self.backend.loads(result_records)
133 return DataFrame.from_records(result_records)
JavaError: java.lang.IllegalArgumentException: 2.02-20-92I probably know what this error means, presumably there is a problem with the string conversion? Could it be something wrong with the following code?Because 2.02-20-92looks like 2022092x
def make_modify_date_pipeline():
return make_pipeline(ExpressionTransformer("X[0][:4] + '-' + X[0][4:6] + '-' + X[0][6:8] if len(X[0]) > 0 and X[0][0:8] < '20221230' else '2022-12-30'"), CastTransformer(dtype = "datetime64[D]"), DaysSinceYearTransformer(year = 2022))
def make_day_id_pipeline():
return make_pipeline(ExpressionTransformer("X[1][:4] + '-'+ X[1][4:6] + '-' + X[1][6:8]"), CastTransformer(dtype = "datetime64[D]"), DaysSinceYearTransformer(year = 2022))
def make_feature_union():
return FeatureUnion([
("modify_date", make_modify_date_pipeline()),
("day_id", make_day_id_pipeline())])But I need to emphasize that the above custom functions work well on pipeline, my pipeline is completely correct and it predicts the correct result.
It seems to be back to the previous problem "My pipeline works fine, I just converted the pipeline to a pmml file and it doesn't work!"
So I don't know whether this is the problem of sklearn2pmml or JPMML-Evaluator-Python. Could you please help me to study it
vruusmann
Hello Villu
I'm sorry that I still need your help to troubleshoot a problem predicted by pmml
Last week, I successfully converted my Python model to pmml.
When I used pypmml to call the prediction, I found that the prediction value was inaccurate. Of course, I followed your instructions and installed JPMML-Evaluator-Python
However, when I used JPMML-Evaluator-Python, it didn't work properly and I just reported an error
Here is my code, written according to the readme prompt
Here is the error code
I tried to analyze the problem by myself, and it seemed that the data format was wrong
However, none of the columns in my input need date format, nor does it need date format itself. I used pipepline before to predict with the same data is OK (I don't know if you still remember, Detailed requirements I mentioned in [sklearn2pmml # 356] (https://github.com/jpmml/sklearn2pmml/issues/356))
I also checked my pmml file and it looks correct as well, none of the 60 features required are date columns
So I can't tell what the problem is.
The only thing I can think of is maybe the problem is not in the input but in the output?
Because I am in order to avoid an error (similar to ), added that one line of code
I don't know whether this is the cause of the problem, in a word, could you help me to make a simple analysis