search

nycmeshnet / meshdb

A convenient, stable, and sane database for tracking Members and Nodes for use with robots and humans
https://db.mesh.nycmesh.net
MIT License
8 stars 13 forks source link

Allow raw SQL queries for analytics access #312

Closed Andrew-Dickinson closed 2 months ago

Andrew-Dickinson commented 5 months ago

Come up with a way to allow raw SQL queries (via a read-only user) for analytics workloads. Export to CSV. Ideally this would be via some type of UI, so that folks don't have to download a postgres client. Maybe there's some kind of Django analytics library that helps with this?

https://nycmesh.slack.com/archives/C06GW3Q92TY/p1712013900917419

WillNilges commented 5 months ago

We could use pgadmin for this.

WillNilges commented 5 months ago

https://www.pgadmin.org/

WillNilges commented 5 months ago

https://hub.docker.com/r/dpage/pgadmin4/

james-otten commented 5 months ago

Redshift vs bigquery? Set up a job to automatically import from offsite backups?

Andrew-Dickinson commented 5 months ago

Definitely possible but probably overkill for our DB size and low traffic volumes. I don’t think we mind cohabitation of OLAP and OLTP