search

deepset-ai / haystack

:mag: AI orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.
https://haystack.deepset.ai
Apache License 2.0
17.59k stars 1.91k forks source link

Combine LLMs with other technologies to build powerful apps #3753

Closed julian-risch closed 1 year ago

julian-risch commented 1 year ago

Problem Statement As an advanced user of LLMs(1), I need some tooling to efficiently combine them with other technologies(2), so that I can build a truly powerful app.

(1) used LLMs before, used OpenAI’s API a lot, experimented with various prompts, is building a real app

(2) google search (SERP API), search your own documents, write+execute SQL query for your own DB, use a calculator, query yahoo finance API, Notion API to create a page, run a python program, send a slack message …

Current assumption: This epic will be a lot around supplying “more external API nodes in haystack”, a mechanism to chain them together and potentially allow multiple executions of one node (not an acyclic graph anymore?). Compare with MRKL, LangChain and Dust

Proposal Tasks

### Implementation Tasks
- [ ] https://github.com/deepset-ai/haystack/issues/3941
- [ ] https://github.com/deepset-ai/haystack/issues/3937
- [ ] https://github.com/deepset-ai/haystack/issues/4099
- [ ] https://github.com/deepset-ai/haystack/issues/4100
- [ ] https://github.com/deepset-ai/haystack/issues/3940
- [ ] https://github.com/deepset-ai/haystack/issues/3942
- [ ] https://github.com/deepset-ai/haystack/issues/4557
- [ ] https://github.com/deepset-ai/haystack/issues/4263
julian-risch commented 1 year ago

Example pipeline draft

A YAML example is in the merged proposal.

aabdullah-getguru commented 1 year ago

We are very interested in this, I'm curious if this is currently available, or is more just on the roadmap?

TuanaCelik commented 1 year ago

Hey @aabdullah-getguru - It's available in the main branch right now but it will be included in the next release officially. You can already try it out if you clone the project from source. It's available in haystack/agents. If you're interested, I was introing it to people in our discord channel today. Feel free to join us there: https://discord.com/invite/VBpFzsgRVF

hyunsir commented 1 year ago

Following.👀

masci commented 1 year ago

As Agents are now fully integrated into Haystack, I'm going to mark this done as we'll tackle the remaining tasks as part of regular maintenance.