search

gkamradt / langchain-tutorials

Overview and tutorial of the LangChain Library
6.63k stars 1.92k forks source link

If I have some mapping already, how let the LLM know and use existing data? #64

Open wowojyc opened 6 months ago

wowojyc commented 6 months ago

in Clean and Standardize Data section. If I have some mapping data already. And the amount exceed token limit so i can not use prompt example. Is there any method to let LLM know these datas and use them?

gkamradt commented 6 months ago

I would try a map reduce method. So extract or clean your data in sections at a time rather than all at once