-
Due to the difficulties of running pyspark on Windows (#13 and #17 ) and it's sole purpose in our application is just to query a parquet file, an alternative that is less OS dependent is preferred for…
-
The `callbacks` is not a fit param.
-
### What is the problem the feature request solves?
As a PySpark user, I would like to be able to install Comet using pip.
### Describe the potential solution
_No response_
### Additional context
…
-
Is reading milvus collection currently supported with pyspark?
If yes, can you please share any documentation/examples of the same
If no, is it on a roadmap for any of the future release?
-
### We would like to learn about your use case. For example, if this feature is needed to adopt Narwhals in an open source project, could you please enter the link to it below?
_No response_
### P…
-
### API
Python
### Description
Have you considered making an integration between Kùzu and PySpark?
Neo4j, as an example, has a [Neo4j connector for Apache Spark](https://neo4j.com/docs/spark/cur…
-
Hi 👋
We are currently experimenting with using `sparkdantic` on our Spark schema definitions in our pipelines inside Databricks. However, based on our current configuration, we are bound to install…
-
Currently the project use pyspark which depends on Spark and Hadoop, dependencies that do not natively run on Windows and make the script not Windows friendly, see #13 for the details. It seems that p…
-
```bash
24/10/07 12:38:57 WARN Utils: Your hostname, seon-uui-MacBookPro.local resolves to a loopback address: 127.0.0.1; using 192.168.0.131 instead (on interface en0)
24/10/07 12:38:57 WARN Utils:…
-
Somehow just starting a local dask client via
```python
from dask.distributed import Client
client = Client()
```
interferes with pyspark, seems like just in the USGS and NWM fetching. Probabl…