futurewei-cloud / chogori-sql

Horizontally scalable SQL Service built upon Chogori-Platform SKV storage
Other
5 stars 6 forks source link

Improve PG scalability per host #187

Open iafuture opened 3 years ago

iafuture commented 3 years ago

In order to allow us to run a single, persistent K23SI proxy per machine, we should test a shmem implementation. A potential downside may be that data has to be copied into the queues, instead of just passing a pointer.

iafuture commented 3 years ago

Alternatively, consider exploring using a connection pooler in order to allow higher number of client threads http://www.pgbouncer.org/ https://node-postgres.com/features/pooling