This feature allow persistence of the models created in issue #17 and #18 (MDS, MIBS, MDIST).
The Spark models should integrates with the ADAM format. New record types may need to be added to the ADAM format.
The ADAM formats can be added as a maven dependency. The structure of the ADAM format is defined in an Avro file. The Avro file can be compiled into Java classes.
For updates to the ADAM format, choose the most simple solution for you as long as it is easy to diff the changes to the Avro file.
Analysis
Add a comment to this issue with:
the missing fields and record types in the current ADAM format
Design
Add a comment to this issue describing how this will be implemented in Spark, and explain how the persistence model will work.
Description
This feature allow persistence of the models created in issue #17 and #18 (MDS, MIBS, MDIST).
The Spark models should integrates with the ADAM format. New record types may need to be added to the ADAM format.
The ADAM formats can be added as a maven dependency. The structure of the ADAM format is defined in an Avro file. The Avro file can be compiled into Java classes.
For updates to the ADAM format, choose the most simple solution for you as long as it is easy to diff the changes to the Avro file.
Analysis
Add a comment to this issue with:
Design
Add a comment to this issue describing how this will be implemented in Spark, and explain how the persistence model will work.
Implementation
The implementation should use: