Open rdsarvar opened 3 weeks ago
Trino already has connection pooling in a number of places. Not sure if they involved JDBI though ... we definitely have some for JDBC connections though. We can probably take some inspiration from there. Or maybe there even is something in airlift (although I dont remember seeing something along that line).
Out-of-the-box JDBI does not seem to leverage connection pools and will create a new connection for every query against the backend datastore as seen in the public Slack channel here. During high traffic this can lead to reaching maximum connection counts against the backend datastore.
It has been noted that there are multiple ways of getting around the limitation of maximum number of connections:
As an enhancement we are looking to minimize overall connections required by Trino Gateway against its backend datastore.