-
TL;DR From the roadmap (#1), we want streaming computation, even on arbitrary expressions and user-defined functions.
```
func wavg(xs, ws):
return sum(xs * ws) / sum(ws)
end
let trades = l…
-
I have a large sequence of data on disk. I'd like to stream it into memory, distribute it to various processes where expensive work is done, collect the results piece by piece onto a master process a…
-
### Is your feature request related to a problem or challenge?
Currently DataFusion somewhat supports computations over Unbounded data, with `SymmetricHashJoinExec` being able to join unbounded strea…
ameyc updated
1 month ago
-
Now that we have lightweight isolates (https://github.com/dart-lang/sdk/issues/36097) we should consider adding convenience abstraction layers on top of the bare-minimum `Isolate` class itself.
The…
-
Currently, we encrypt all messages in the RHP with ChaCha20-Poly1305. This means that sector data is encrypted twice. The encryption itself adds some overhead, but not enough to worry about. However, …
-
[10.1109@IPDPSW.2016.138.pdf](https://github.com/andresvivancov/BDAPRO-WindowsBenchmarking/files/667721/10.1109.IPDPSW.2016.138.pdf)
-
https://people.csail.mit.edu/matei/papers/2013/sosp_spark_streaming.pdf
Spark Streaming
-
Just noticed that streaming mode gives much slower computation as compared to its standard mode alternatives while using the ```VectorInput``` algo in the python wrapper.
Did a small test comparing…
-
### Is your feature request related to a problem or challenge?
Hi DataFusion community,
Last month on June 24th, 2024 we demonstrated our POC Stream Processing system on top of DataFusion at the…
ameyc updated
1 month ago
-
### Search before asking
- [X] I have searched in the [issues](https://github.com/NetEase/arctic/issues?q=is%3Aissue) and found no similar issues.
### What would you like to be improved?
We have i…