Clickhouse - split the ingestion & query tables in separate databases for better access control

[ivor11]

In order to support our earlier use case where we wanna reduce user confusion etc for tables on grafana,

we've decided to restrict grafana (and application) access to query tables only.

in order to do this we've decided to separate the query & ingestion database names

table format - hyperswitch_<env>_pub for query tables & hyperswitch_<env> for ingestions tables

with this format we will be creating new databases with the _pub suffix

in this case the Kafka & MV tables would reside in the private db while the cluster & audit tables would reside in the public database...

as part of this let's also delete the dist tables and query directly from cluster tables since we don't use sharding... in this case we'll rename the clustered tables to remove the clustered suffix e.g payment_attempt_clustered -> payment_attempt

The following action items need to be taken

• [ ] Create new database with _pub suffix
• [ ] Create a replica cluster/audit table in the newer public db & backfill it from the older cluster table
• [ ] setup an mv from queue to cluster/audit tables
• [x] code changes to change the table name (instead of relying on payment_attempt_dist we'll rely on payment_attempt)
• [x] env changes to specify the newer database names
• [ ] update access for the users to have access only to their respective env public databases

[ivor11]

can we split roles & acl into a separate task?