search

bcgov / cthub

Apache License 2.0
2 stars 5 forks source link

CTHUB - new database for ds and engineering needs #387

Open katerinkus opened 2 months ago

katerinkus commented 2 months ago

Describe the task Data scientists need to have an option to add their data into OpenShift without having to use the CTHub upload tool.

Purpose Currently, one of the projects is generating gigabytes of data that the data scientist is accessing locally using PostgreSQL. Our only storage option is on LAN which is not useful for this type of work. A database on OpenShift would be a solution to this problem.

Acceptance Criteria

Additional context This database may also be eventually connected to DAP (with PIA's in place) to use with PowerBI or other dashboarding tools.

kuanfandevops commented 2 months ago

Had a conversation with Katia. Will create a new Crunchy DB cluster on Zeva Test and handover to the data scientist.

kuanfandevops commented 1 month ago

Created ds-test-crunchy-ds cluster on Zeva Test. @katerinkus DS can login through terminal and give a try.