multinet-app / multinet-api

Apache License 2.0
2 stars 2 forks source link

Simplify the table and network upload logic and take column types for JSON data #158

Closed JackWilb closed 1 year ago

JackWilb commented 1 year ago

Does this PR close any open issues?

Closes #48 Closes #102 Closes #109

Give a longer description of what this PR addresses and why it's needed

This PR simplifies the upload logic since all uploads involve moving the data uploaded into Arango tables and then setting column types. I included a new file, process_single_table that does all the type conversions to the data based on the user specified types.

There are still several TODOs before this is ready to go which are tracked down below.

Provide pictures/videos of the behavior before and after these changes (optional)

N/A

Are there any additional TODOs before this PR is ready to go?

TODOs: