task: create list of features for the prototype - Githubissues

RuiFilipeCampos / git-datasets

Declaratively create, transform, manage and version ML datasets.

4 stars 0 forks source link

task: create list of features for the prototype #4

Closed RuiFilipeCampos closed 11 months ago

RuiFilipeCampos commented 11 months ago

database

[ ] feat: adding a field creates a new column in the database (added to tracker)
[ ] feat: removing a field deletes a column from the database (added to tracker)
[ ] feat: running the script auto-commits the changes

data directory

[ ] feat: use git lfs to track files in the data dir
[ ] feat: adding a File field creates a directory in the data directory
[ ] feat: removing a File field renames the directory

data transformation

[ ] feat: static methods for fields that result from transformation of the previous fields

cli - simple cli for operations that don't fit this flow

[ ] feat: undo operation - removes last commit
[ ] feat: import dataset from external formats
[ ] feat: purge unneeded data (columns are never thrown away, only renamed)

points to think about:

how will deletion be handled, data deletion, file deletion
deleting columns from sqlite3 is not possible

WIP

RuiFilipeCampos commented 11 months ago

list of features added to one of the trackers