Open aaronsteers opened 1 month ago
hi @aaronsteers can I have more information on this topic would love to contribute to it.
can you give us the summary on this?
@Hashcode-Ankit it is yours
Hi @marcosmarxm thanks for assigning it to me @aaronsteers can I expect some more details on it? I have set up Airbyte and built some connectors using Airbyte. Need more information about how to approach this so that I can break down it into even more simple chunks.....
@Hashcode-Ankit - I've updated the above with a description. Admittedly, this is a large and ambitious project. Let us know if it is still interesting, and/or if you have any questions or changes you would like to propose.
@aaronsteers Yes as I mentioned on Slack as well, I am very much excited about it, and it matches my previous work on dbt and dbt-clickhouse.
Hi @aaronsteers @marcosmarxm as discussed on slack i have pushed the code for it : https://github.com/Hashcode-Ankit/pyairbyte-dbt Need some more guidance on task to complete the exact use case @aaronsteers let me know if we can connect.
Summary
The goal with this application is to take a specific raw data schema for a source being run with PyAirbyte and to auto-generate a simple dbt project for that data.
This could be the foundation of a new type of integration opportunity for Airbyte users.
Definition of Done
These are not specifically related to GenAI, but are the foundation of the code-gen:
dbt run
, as proof of the working solutionThe GenAI "code gen" application portion of this project is:
In terms of documentation:
Suggestions (Per Author's Discretion)
These are some suggestions - but are not required:
source-faker
,source-coin-api
, or similar.Resources to Assist