mayooear / gpt4-pdf-chatbot-langchain

GPT4 & LangChain Chatbot for large PDF docs
https://www.youtube.com/watch?v=ih9PBGVVOO4
14.94k stars 3.02k forks source link

Pinecone metadata size #383

Closed themrzmaster closed 1 year ago

themrzmaster commented 1 year ago

I was running fine the ingestion, but now i get:


creating vector store...
error [PineconeError: PineconeClient: Error calling upsert: PineconeError: metadata size is 114146 bytes, which exceeds the limit of 40960 bytes per vector]

default configurations

any ideas? is this a pinecone thing? how could we reduce the metadata?

weird that my pdfs are not big and was working fine