Illustrate the usage of `langchain_airbyte` package

bindipankhudi commented 3 months ago

Summary

The goal is to show how LangChain users can load data from Airbyte sources (such as Github) using langchain_airbyte package, store the data into a vector database, and perform a basic QnA on that data.

Description

This tasks involves the following steps:

Use langchain-airbyte package to load data from a specific Airbyte source. This package will load data into documents.
Store the documents in a vector db of your choice
Perform a QnA on stored data

Deliverables

Python notebook illustrating the end to end process above. Please add a "What / Why / How" blurb at the top of the notebook to explain what the code is doing.

Resources

LangChain-Airbyte package usage: https://python.langchain.com/v0.2/docs/integrations/document_loaders/airbyte/
PyAirbyte tutorials: https://github.com/airbytehq/quickstarts/tree/main/pyairbyte_notebooks (includes GenAI example)
PyAirbyte Documentaton: https://docs.airbyte.com/using-airbyte/pyairbyte/getting-started
PyAirbyte API Reference: https://docs.airbyte.com/using-airbyte/pyairbyte/getting-started#api-reference

marcosmarxm commented 3 months ago

It is yours @rifaqat-ali

ombhardwajj commented 3 months ago

@rifaqat-ali are you still working on it?

ombhardwajj commented 3 months ago

@marcosmarxm Please assign it to me , I would like to work on this!

marcosmarxm commented 3 months ago

@ombhardwajj done

ombhardwajj commented 3 months ago

Please review airbytehq/quickstarts#119

bindipankhudi commented 3 months ago

@ombhardwajj added a comment to PR.

ombhardwajj commented 3 months ago

@bindipankhudi Please review the updated PR! airbytehq/quickstarts#119

bindipankhudi commented 3 months ago

Hi @ombhardwajj, Thank you for updating the PR. Reviewed and merged! 🥳

airbytehq / PyAirbyte-Hackathon