Data Preparation 1 of N - Githubissues

traindb-project / traindb-ml

Remote ML Model Serving Component for TrainDB

Apache License 2.0

6 stars 2 forks source link

Data Preparation 1 of N #23

Closed kihyuk-nam closed 2 years ago

kihyuk-nam commented 2 years ago

setup.py (main file for setting up and launching the app)
- move /interface/dev/setup.py to /setup.py (should be in root)
- implement args/dirs related stuffs
add /data/preparation/...
add /data/schemas (for SchemaGraph objects)

ASSUME:

for an input csv file (e.g. orders.csv) with the dataset name (e.g. instacart):
- create /data/instacart
- create /data/instacart/csv and copy orders.csv here
- create /data/instacart/hdf for storing hdf files from the given csv
- reference /data/schema/instacart.py for creating SchemaGraph objects