brianpetro / jsbrains

A collection of low-to-no dependency modules for building smart apps with JavaScript
https://jsbrains.org
MIT License
27 stars 7 forks source link

Implemented PDF Adapter in Smart Chunks #7

Open vguillet opened 1 year ago

vguillet commented 1 year ago

Hey, absolutely in love with the plugin so far. One of the main limitations I would say so far is the lack of PDF support, images text extraction, etc... A number of plugins might help with this, such as the text-extractor plugin (leveraged by the omnisearch plugin for this very purpose), but having the ability to also get responses based on images and pdfs would go such a long way to improving the chat quality (in my case at the very least XD). Cant wait to see where this plugin heads next non-the-less!

brianpetro commented 1 year ago

Hey @vguillet

Great suggestion. I think PDF support would be a great addition.

Already peaked at https://github.com/scambier/obsidian-text-extractor but I'll have to do some more investigating to better understand how an integration might work.

For images, I think we just need to wait for the release of GPT-4's multimodal capabilities. That should allow an easy integration.

Thanks again for your continued helpful feedback!

Brian 🌴

engr-lynx commented 1 year ago

Agree, especially pdf support. A lot of references are in pdf. Having the ability to make smart connections between these and your own notes is a game-changer.

dannygithub1 commented 1 year ago

Agree - this would be a complete changer. Often my PDFs are themselves pieces of work I produce which do not get retyped in Obsidian.

brianpetro commented 2 months ago

In the meantime, check out this video for how the Smart Connect GPT can help create notes that semantically represent the PDF such that it's discoverable in Smart Connections 🌴

brianpetro commented 2 months ago

Recorded response https://youtu.be/J3j-2XRic8I

brianpetro commented 2 months ago

Recorded response https://youtu.be/J3j-2XRic8I