search

LAION-AI / Open-Assistant

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.
https://open-assistant.io
Apache License 2.0
37.04k stars 3.23k forks source link

ChatPDF #2369

Closed zas97 closed 1 year ago

zas97 commented 1 year ago

Would it be possible in the future to chat with Open-Assistant with the context of a pdf like in https://www.chatpdf.com/?

olliestanley commented 1 year ago

The basic requirement for this is just performing OCR on the PDF to extract text and then feeding that text into the LLM context as normal. It should be possible, might be a good candidate for a plugin/integration

zas97 commented 1 year ago

If it is a large pdf file it also needs to be chunked in and then perform a query to only input the relevant chunks into the LLM as context.

zas97 commented 1 year ago

Could you give me some hints as to how could I create a plugin with such functionality?

olliestanley commented 1 year ago

Could you give me some hints as to how could I create a plugin with such functionality?

We don't have a final specification for how plugins for OA will be developed yet, but there are people working on it

tobiasoberrauch commented 1 year ago

Looking forward to see the plugins and especially with pdf files

olliestanley commented 1 year ago

It is now possible to use plugins for this with the same spec as OpenAI

tobiasoberrauch commented 1 year ago

It is now possible to use plugins for this with the same spec as OpenAI

Is there an example where I can find in the docs?