[Feature] :grey_question: Support for html/pdf pages and YT videos ?

[adriens]

Is this your first time submitting a feature request?

• [X] I have searched the existing issues, and I could not find an existing issue for this feature
• [X] I am requesting a straightforward extension of existing functionality

Describe the feature

Hi, I see in the README that canopy actually supports local files likes parquet, is there nay kind of DocumentLoader for online contents like:

• YT Video
• Html page

... and does it support local pdf import ?

Describe alternatives you've considered

• Scrap web content into text files then load them
• For YT : build transcript, then load the txt output

Who will this benefit?

I gues almost any lazy people wanting to give a try and use canopy

Are you interested in contributing this feature?

No response

Anything else?

No response

[strelkon]

Would it be possible to use an existing Pinecone index for Canopy? I built it from PDF files using llama-index; and also the free version of Pinecone does not support more than one index - so it would be great to re-use the existing one...

UPD: Yes, I found in the docs that this is not possible. Although beforehand I have tried to bypass this and first created a Pinecone index through Canopy and then filled it in externally - the server was set up and running without issues, however, when I tried to chat, an error was thrown. So I converted all .pdf in the directory to .txt files and upserted them through Canopy.

[pashpashpash]

PDF is a must have

[NB-123]

Yes, please include PDF in Canopy

[kowshik24]

@adriens @NB-123 @pashpashpash @strelkon Check out this library: PineconePDFExtractor it will accept a list of pdf files and convert them back to your desired format so that you can use pinecone-canopy's upsert data into this endpoint: v1/context/upsert on FastAPI

[adriens]

Thanks a lot for pointing this library @kowshik24 :pray: