FlowiseAI / Flowise

Drag & drop UI to build your customized LLM flow
https://flowiseai.com
Apache License 2.0
31.59k stars 16.47k forks source link

[BUG] upsert multiple documents qdrant #834

Closed jsu-github closed 1 week ago

jsu-github commented 1 year ago

upsert multiple documents qdrant does not work. It returns: Error: Bad Request

I have tested both .txt and .docx files as input, both failed.

What is working fine:

Upserting multiple documents in Pinecone works fine.

Anush008 commented 1 year ago

Hey. I'm working on this issue. Will circle back to you if I can come-up with a fix.

jsu-github commented 1 year ago

Sounds great!

John

On Sat, 9 Sept 2023, 20:21 Anush, @.***> wrote:

Hey. I'm working on this issue. Will circle back to you if I can come-up with a fix.

— Reply to this email directly, view it on GitHub https://github.com/FlowiseAI/Flowise/issues/834#issuecomment-1712571262, or unsubscribe https://github.com/notifications/unsubscribe-auth/ASZ2MLTBS4QP4YDTWUFJKW3XZSXT7ANCNFSM6AAAAAA37ZTX5M . You are receiving this because you authored the thread.Message ID: @.***>

Anush008 commented 1 year ago

@jsu-github, I looked at the implementation and upserting multiple .txt and .pdf files works as expected. Can you provide the error logs to see if we can get something from there?.

With PDF files

Screenshot 2023-09-10 at 1 36 35 PM

With text files

Screenshot 2023-09-10 at 1 40 01 PM
ENGSamShamsan commented 1 year ago

is this how we do multiple txt? i only see the option to upload one document???

Anush008 commented 1 year ago

is this how we do multiple txt? i only see the option to upload one document???

You can select multiple files from the file explorer.

ENGSamShamsan commented 1 year ago

that does not work for me <img width="2535" alt="Screen Shot 2023-09-26 at 10 24 09 PM" src="https://github.com/FlowiseAI/Fl

Screen Shot 2023-09-26 at 10 24 29 PM

owise/assets/41812691/d6ee5deb-bfb9-4c5e-9344-53217344c00d">

ENGSamShamsan commented 1 year ago

I am getting this error

Screen Shot 2023-09-26 at 10 24 09 PM
Anush008 commented 1 year ago

I tried the same flow as yours. The upserting and retrieval worked fine for me. Can you confirm the collection is being created with your data from the Qdrant dashboard?

DevOtts commented 1 year ago

@Anush008 I don't know if this is related or if you can help me.

I notice that when I upload a document to QDrant using Flowise, it creates in qdrant a "content" field and when we use the langchain code it creates the field "page_content".

Because of that, I have an incompatibility when I try to chat with collections that I create using qdrant-client.

Any thoughts on that? Screen Shot 2023-10-27 at 21 05 16