When a user uploads a new file, json lines or csv or any format. Catalog the documents in the hbase table <project_name>_catalog as described in #253 .
Initially the date_processed is empty and status is 0.
If the uploaded file is a json lines file, catalog each individual json object, if its a csv or tsv or excel etc, create a wrapping json object and catalog the wrapping json object.
Update the table dataset_view as described in #254 . This table will only updated when documents are either uploaded or deleted from myDIG.
When a user uploads a new file, json lines or csv or any format. Catalog the documents in the hbase table
<project_name>_catalogas described in #253 . Initially the date_processed is empty and status is 0.If the uploaded file is a json lines file, catalog each individual json object, if its a csv or tsv or excel etc, create a wrapping json object and catalog the wrapping json object.
Update the table
dataset_viewas described in #254 . This table will only updated when documents are either uploaded or deleted from myDIG.