search

gordonwatts / snowmass-chat

Experiments exploring the US Snowmass Process documents using LLM
Apache License 2.0
2 stars 0 forks source link

Add a keyword extraction DB to the system #22

Closed gordonwatts closed 10 months ago

gordonwatts commented 10 months ago

This is a step towards including keywords as well as vector similarity in the way we get sources. This is not built into langchain, unfortunately.

gordonwatts commented 10 months ago

In the end, this rake extracted "phrases" that were important in sentences, not nouns, which is what we need. So, closed this in the end.