search

rheem-ecosystem / rheem

Rheem - a cross-platform data processing system
https://rheem-ecosystem.github.io
5 stars 0 forks source link

Add support for multiple sinks in Scala and Scala-like api's #33

Open luckyasser opened 7 years ago

luckyasser commented 7 years ago

Right now a Rheem plan is concluded via the collect() method, which adds a sink and executes the plan. While Rheem does support multiple sinks (using the basic Java api), we need to extend this support to the Scala and Scala-like Api.

sekruse commented 7 years ago

I find it interesting how one would design such an API. The future pattern/idiom seems to be a promising candidate to me.