-
**Is your feature request related to a problem? Please describe.**
Currently, `pandera`'s type system is strongly coupled to the `pandas` type system. This works well in pandera's current state sin…
-
Hi, I tried to get some simple statistics on all my numeric columns. Although I just wanted to retrieve the shape of it by calling `sdf_dim()`, I got error message saying tasks exceeding driver.maxRes…
-
Hello, I just happen to run the native Python code example from the "Introductions" [page](https://fugue-tutorials.readthedocs.io/en/latest/tutorials/beginner/introduction.html):
```
from typing imp…
-
Trying to create a table in a non-default database generates the following error:
Error: org.apache.spark.sql.AnalysisException: Hive support is required to CREATE Hive TABLE (AS SELECT);;
```…
-
I'm encountering this error on spark-3.0.0 on databricks:
`org.apache.spark.sql.avro.IncompatibleSchemaException: Cannot convert Catalyst type StringType to Avro type ["string","null"].
at org.ap…
-
# Bug: Notebook Editor, Interactive Window, Editor cells
## Steps to cause the bug to occur
1. set a virtual env (python interpreter)
2. specify a remote jupyter server
3. open a ipynb file
…
-
Hi,
I'm currently using PySpark 3.1.1 and I'm using petastorm to be able to use my TF models with Spark Dataframes.
After much digging through the examples I'm struggling with some implementations.…
-
Mainly to come up with the possible ways of extracting acknowledgement statements which will be streamed down to projects mining within the IIS later on. This will not become a part of a master branch…
-
In my pandas dataframe, I have columns/variable names with whitespace and parantheses, which I had heard ROOT does not support. Just out of curiosity, I tried writing it to a ROOT TTree with uproot 4.…
-
Hi
We are creating relationship between existing nodes in the database using the below query from databricks.
```scala
JournalLineItemdf.repartition(1).write.format("org.neo4j.spark.DataSource")
…