-
**Describe the problem you faced**
We are trying to POC Hudi with our existing streaming job which consumes from AWS Kinesis Data Stream, and deliver as parquet in S3. The job is running continuously…
-
Hi 👋🏻
Loving ollama always ❤️
I'm eager to use newly released structured output using ollama but it looks like ollama doesn't have compatibility yet so I can just put base_url and I'll get res…
-
## Structured Streaming之Continuous Processing尝试
-
### Feature Description
When using the new array streaming (`output: "array"`) feature with streamObject, users can't use the same schema between the `useObject` and `streamObject` functions. Current…
-
### Is your feature request related to a problem? Please describe.
Currently storing data consists of utilizing a combination of slots and dynamic variables which is somewhat alright for structured…
-
-
### What kind an issue is this?
- [X] Feature Request.
### Feature description
When using ILM (index lifecycle management) and its roll over API implementation, your ingest job needs to point at …
-
Hi
I'm trying to use spark-highcharts with structured streaming DataFrame as below (spark 2.1.0, zeppelin 0.7):
```
import com.knockdata.spark.highcharts._
import com.knockdata.spark.highcharts.…
-
http://datahacker.me/2019/01/22/spark-sql-streaming-performance-profile/#more
-
At the moment, Spark does not support window functions (like `lag` or `head`) on a stream.
It would be great if you could add support for those type of operation.