Database adapter, PostgreSQL support

bsinou commented 5 years ago

Hi,

We have been working on a first PoC a few weeks ago, (see branch pgsql-poc) and had been able to start Cells with service pydio.grpc.acl backed by a PostgreSQL DB.

This helped us to have a better overview of what has to be done and there is some work at hand, that is mainly:

rewrite all DB creation / migration scripts for each microservice that is backed by a DB with PGSQL specific syntax
adapt our store procedures that are using MySQL specific place holders, for this we must either:
- rewrite all parametrized stored procedure using Goqu
- choose a strategy (Qoqu might also come handy here) to translate the stored procedures either once or dynamically during initphase of the service from MySQL syntax to PGSQL syntax: the place holder in prepared statements depend on the adapter (e.g. ? mysql, $1 postgres, ? sqlite3)
enrich our non regression tests to insure switching to PGSQL does not break anything
benchmark pretty big systems backed with PGSQL to insure it holds the load. This benchmarking would also help us to gather some best practices and PGSQL specific fine tuning tips.

We do not really have the time to do this alone by ourselves in a very near future, yet we think this is a good candidate for a community driven effort to which we would take part.

Would anyone be interested to take part in the process?

LNAhri commented 2 years ago

Simillar to this Point: https://github.com/pydio/cells/issues/319.

Also did you guys heared from gorm ? Pretty good library for also handling multiple DB backends. https://gorm.io/

DUOLabs333 commented 2 years ago

The POC has not been updated in quite a while. Is it able to just be rebased on master?

cdujeu commented 2 years ago

hello! very probably ... not. we have not put much effort on that PG support lately.

elhananjair commented 3 months ago

Postgres is very popular now a days and easy to configure it would be best if it available as an option

bsinou commented 3 months ago

We are working on it. Stay tuned.

aleksasiriski commented 3 weeks ago

Any updates on this?

cdujeu commented 1 week ago

yep - it's going well in the current development cycle. Target for v5, ~mid november

pydio / cells

Database adapter, PostgreSQL support #85