-
-
-
-
```
java.lang.NoSuchFieldException: org.apache.hadoop.hdfs.client.HdfsDataInputStream.file
at za.co.absa.commons.reflect.ValueExtractor.$anonfun$extract$2(ValueExtractor.scala:39)
at scala.Option…
-
Spark has Partition Pruning rule which under right condition can fetch all the join keys of one side of the table, and pass it as an In Clause filter to other table.
For eg if the query is select …
-
We should improve the documentation/justification for this interface, describe better what happens when it's not supported, and make sure it lines up with what potential users of the interface expect.…
-
Spark Structured Streaming Runner uses currently non stable Spark APIs for its Source translation, the DataSourceV2 API was changed on Spark 3. We need probably a new class or a new compatibility laye…
-
**Describe the bug**
When running NDS query 16 on EMR 6.8.0 with AQE enabled, the following exception is encountered:
```
py4j.protocol.Py4JJavaError: An error occurred while calling o192.collectT…
-
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
### Search before asking
- [X] I have searched in the [issues](http…
-
- Scala v2.12
- Spark v3.2.1
- Spline v0.7.8
Running a command in the style of
```
create table B as (
select val from A
)
```
throws a `java.lang.NoSuchFieldException`. The `Create…