Add Flink read/write operations to MatrixObject

stratosphere / incubator-systemml

Mirror of Apache SystemML (Incubating)

Apache License 2.0

1 stars 4 forks source link

Add Flink read/write operations to MatrixObject #16

Closed fschueler closed 8 years ago

fschueler commented 8 years ago

The MatrixObject class is currently married to Spark's RDDs.

To be able to use (CSV)ReblockFLInstructions, we need to add all equivalent Flink read/write operations and decide based on the current runtimeplatform which operations to use.

It would probably be nicer to introduce some form of class hierarchy here but this could potentially touch many parts in the code.

fschueler commented 8 years ago

[x] readMatrixFromDataSet(DataSetObject dso, MutableBoolean writeStatus)
[x] update acquireRead()