tusharchou / local-data-platform

python library for iceberg lake house on your local
MIT License
8 stars 5 forks source link

0.1.4 DBT Transformation layer #45

Open redpheonixx opened 1 month ago

redpheonixx commented 1 month ago
redpheonixx commented 1 month ago

Steps

  1. Set up environment with dbt, DuckDB installed preferably a docker compose file
  2. Configure dbt_project.yml file to support iceberg
  3. Configure DuckDB to work with Iceberg Tables
  4. Develop dbt models
  5. Write unit test cases
tusharchou commented 1 month ago

Hi @redpheonixx This looks ambitious. Let's break it down to single responsibility principle. Start with DBT documentation.

41 use this PR to explain how this will help.