IBM / data-prep-kit

Open source project for data preparation of LLM application builders
https://ibm.github.io/data-prep-kit/
Apache License 2.0
305 stars 134 forks source link

DPK Integration with LangChain #784

Open Bytes-Explorer opened 2 weeks ago

Bytes-Explorer commented 2 weeks ago

Lets use this issue to describe what is needed to integrate DPK with Langchain and then do the actual integration work. cc @agoyal26

agoyal26 commented 1 week ago

@revit13 You may have noticed in slack thread - integration with Langchain really helped Docling. So would like to take this thread on priority if feasible for you. Should we target Document transformers and toolkit section to showcase/integrate DPK with Langchain?

Screenshot 2024-11-12 at 10 03 23 AM