search

carnival-data / carnival

JVM property graph data unification framework
https://carnival-data.github.io/carnival/
GNU General Public License v3.0
7 stars 2 forks source link

CacheFiles object #29

Closed augustearth closed 3 years ago

augustearth commented 3 years ago

There are currently two styles of vines: Json and MappedDataTable. Json vines have a single unified cache file which contains both the data and meta-data. MappedDataTable has two files, a Yaml meta file and a CSV data file. The cache related vine methods for these two styles of vines differ. Json cache is a bare File. MappedDataTable cache is a DataTableFiles object. Unify these two into a single CacheFiles (or similar) object that has standardized functionality.

augustearth commented 3 years ago

I'm not 100% certain we need to do this. The data table vine methods have a DataTableFiles object to encapsulate the two cache files. I am not certain we need to unify the JSON vine methods. If this becomes an issue, we can re-open or re-create.