-
To reproduce:
```kt
val df = dataFrameOf("a.b", "a.c.d", "d.e", "d.f")(1, 3.0, 2, "b")
.move { all() }.into { it.name.split(".").toPath() }
```
| a | d |
| :--- | :--- |
| {"b": 1, "c": {…
-
The DataFrame library currently targets Java 8. This is to ensure the widest compatibility across the board and follow [Kotlin/JVM itself](https://kotlinlang.org/docs/faq.html#which-versions-of-jvm-do…
-
Hi @jerolba . First, wanted to thank you for the great series of blog posts on Parquet and Java! This is the best piece of information on the topic I found so far.
I have a question about the Carp…
-
I'm encountering a ClassCastException when using Record Level Indexing (RLI) with Hudi 0.14.1 and Spark 3.4. The issue occurs on the second run of my script after restarting the Spark shell.
Steps …
-
**Description**
I have two PySpark dataframes, source_df and target_df. I ran `pip install pyspark-extension` to install diff.
Spark Version - 3.4.1
Scala Version - 2.12
When I run `source_…
-
**Description**
As part of our ongoing efforts to expand the range of databases supported by the Kotlin DataFrame project, I propose adding support for [Apache Pinot®](https://pinot.apache.org/). Apa…
-
Hi there
I'm using this package io.github.spark-redshift-community:spark-redshift_2.12:4.2.0 as a dependency in the context of AWS EMR job trying to save a dataframe to Redshift.
Sadly this atte…
-
DataFrame fails on simple actions with casting BigInteger to Long.
For example, the MySQL performance schema table_handles table is defined as:
```
show create table performance_schema.table_ha…
-
Java Developers need a easy way to create Dataframes from in-memory Java Collections. This will Morpheus much more suitable for generic Java development.
I am proposing a class called ListSource or…
-
If you have a `DataFrame` consisting of a mix of `Number` types, calling `median` on it will break.
Example:
```
val df = dataFrameOf("a")(
1,
2L,
2.0f,
3.0,
)
df.median…