Doing this on plain Spark gets the same exception when registering the temp views:
scala> val res = spark.read.parquet("...")
res: org.apache.spark.sql.DataFrame = [... 122 more fields]
scala> res.createOrReplaceTempView("people-ww")
org.apache.spark.sql.AnalysisException: Invalid view name: people-ww;
at org.apache.spark.sql.Dataset.org$apache$spark$sql$Dataset$$createTempViewCommand(Dataset.scala:2687)
at org.apache.spark.sql.Dataset$$anonfun$createOrReplaceTempView$1.apply(Dataset.scala:2640)
at org.apache.spark.sql.Dataset$$anonfun$createOrReplaceTempView$1.apply(Dataset.scala:2640)
at org.apache.spark.sql.Dataset.org$apache$spark$sql$Dataset$$withPlan(Dataset.scala:2872)
at org.apache.spark.sql.Dataset.createOrReplaceTempView(Dataset.scala:2639)
... 48 elided
The behaviour for labels when using either the SQL action or
debugAsTable
is currently incorrect as it will allow you to create a label with hyphens.Expected Behavior
Two options:
Actual Behavior
When using the following action and
debugAsTable
you get the following error:Doing this on plain Spark gets the same exception when registering the temp views:
Specifications