julioasotodv / spark-df-profiling

Create HTML profiling reports from Apache Spark DataFrames
MIT License
195 stars 77 forks source link

AnalysisException - Undefined function: percentile_approx #9

Open valtheval opened 7 years ago

valtheval commented 7 years ago

Hello,

I am facing the following issue when using spark-df-profiling: AnalysisException: u"Undefined function: 'percentile_approx'. This function is neither a registered temporary function nor a permanent function registered in the database 'default'.; line 1 pos 0" Does anyone have any idea to fix this problem? Thanks in advance !

Full screenshot below:

spark_error spark_error02

julioasotodv commented 7 years ago

I see. What Spark version are you using? Did you compile Spark with Hive support? That function comes from Hive's builtin UDFs...

valtheval commented 7 years ago

I am using spark 2.0.1. It seems that Hive support is included in this version by default.