tweag / sparkle

Haskell on Apache Spark.
BSD 3-Clause "New" or "Revised" License
447 stars 30 forks source link

Finish the apps/rdd-ops-safe example #168

Open facundominguez opened 2 years ago

facundominguez commented 2 years ago

Support for linear types when working with streams needs to be implemented or worked-around to finish the conversion of the example from the unsafe to safe (linear) interface.

This issue is a follow up of #160

aspiwack commented 2 years ago

Is the linear stream sub-library from linear-base sufficient to address this?

facundominguez commented 2 years ago

It may. We need to get into writing a safe interface for jvm-streaming to understand the difficulties.