-
Hi all, how do I get Spark.jl to read a stream from and write to Kafka? I need help finding documentation on that.
-
### Apache Iceberg version
1.4.0
### Query engine
Spark
### Please describe the bug 🐞
We use spark structured streaming to consume avro message from kafka and write them to iceberg tables, see fo…
-
### Checked other resources
- [X] I added a very descriptive title to this issue.
- [X] I searched the LangChain documentation with the integrated search.
- [X] I used the GitHub search to find a sim…
-
There are some files with the suffix ".compact" in the sink folder of Spark checkpoint location.
The files compact all the history EsSinkStatus logs since the first index action.
 that indicate how behind a stream is…
-
Hi, when i want to run the app
.PHONY:
streaming-app-run: # Run Spark Structured streaming app locally.
poetry run spark-submit \
$(SPARK_ARGS) \
movie_ratings_streaming/entrypoint.py
if…
-
Hi team, I just watched a talk from Ricardo and Tristan on Mar 16, 2021. At the end there was a question from the audience about support for streaming. It seemed the answer was not at this time, and T…
-
Hi,
I have a Spark Structured Streaming application where I'd like to write streaming data to HBase using SHC. It reads data from a location where new csv files continuously are being created. The …
-
Hello, I am implementing the "VideoObject" and "SoftwareApplication" schemas on my website [Flujo TV Video](https://flujotvvideo.com/), but I've encountered some issues and errors when validating the …
-
### Self Checks
- [X] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general).
- [X] I have s…