search

italia / daf-dataportal

The DAF Dataportal is the front-end project of the PDND portal available at this link.
https://dataportal.daf.teamdigitale.it/
GNU Affero General Public License v3.0
22 stars 24 forks source link

Create an API endpoint to save data on PostgreSQL #43

Open ruphy opened 7 years ago

ruphy commented 7 years ago

Create an API endpoint, linked to the ingestion form, which will save the data on an external PostgreSQL database.

simonacca commented 7 years ago

Would postgrest suffice?

fabiofumarola commented 7 years ago

PostgREST is a standalone web server that turns your PostgreSQL database directly into a RESTful API. The structural constraints and permissions in the database determine the API endpoints and operations. @ruphy what do you think? if you want we can create an example project on the daf-recipes project

giux78 commented 7 years ago

yes for me is perfect. The goal is to have some endpoints where data csv and json go into postgres and can be queried easily. Seems perfect. Maybe can be added more functionality on top of the API.

fabiofumarola commented 7 years ago

ok, cool

ermannob commented 7 years ago

What about using PostgreSQL Json query engine over No-sql data? The form can be serialized to JSON and saved into a PostgreSQL's json field. I think is viable and more flexible compared to structuring the data. What kind of use cases do you have in mind?

giux78 commented 7 years ago

Yes, @ermannob the use case is to use postgres instead of the big data layer for working locally with DAF without connecting to a cluster. We have many tools (metabase, superset, jupyter via spark), api ecc that can interact with postgres and could be useful to have a single entry point for the data