Apply Factory pattern into other tables

lelouvincx / Chinh-Dinh-training

This project is about database replication using Apache Kafka in near real-time, from Postgres to MS SQL Server.

5 stars 0 forks source link

Apply Factory pattern into other tables #2

Open lelouvincx opened 1 year ago

lelouvincx commented 1 year ago

Currently the Fake Data Generation app can generate only 1 table: public.test.

Trouble in creating generating functions for other tables.

Todos:

[ ] A json file, saves database schema. (So that the Streamlit app can initialize schemas and tables.
[ ] Class Table has:
- [x] Auto update schema
- [ ] For each datatype from PostgreSQL, create factory pattern with corresponding Faker()

lelouvincx commented 1 year ago

Data catalog here: https://dbdocs.io/lelouvincx/WideWorldImporters

lelouvincx commented 1 year ago

Data types extracted from database: {'int8', 'numeric', 'bool', 'varchar', 'date', 'int4', 'text', 'timestamp', 'bytea', 'bpchar'}

Trong Faker có nhiều loại kiểu dữ liệu để fake, gọi là Provider. Một số Provider cơ bản: address, automotive, color, company, geo, text, sentence, zipcode...