search

1jamesthompson1 / TAIC-report-summary

Using LLM technologies to analyze transport accident investigation reports
https://taic-document-searcher-cfdkgxgnc3bxgbeg.australiaeast-01.azurewebsites.net/
GNU General Public License v3.0
0 stars 0 forks source link

Add in support for a forced fts search #201

Open 1jamesthompson1 opened 3 months ago

1jamesthompson1 commented 3 months ago

State

The only search option at the moment is to do a semantic search using queries.

Problem

If you want to search for a specific keyword it is not possible in the current state.

These keywords may be business names, place names etc.

Solution

I can add in the support to force a direct keyword match with a check box or "" notation. This could be done with a fts search however currently lancedb does not support that on the cloud. Atleast I dont think so. More testing will need to be done.

Otherwise I will implement my own search of the pandas df. I believe it is possible to do this in a fast enough way.

1jamesthompson1 commented 4 weeks ago

This has been removed becuase fts is not supported in remote tables.

However since https://github.com/lancedb/lancedb/pull/1483 it is added to lancedb v0.13 beta.

Once it is fully released I can add it into

1jamesthompson1 commented 4 days ago

Since https://github.com/lancedb/lancedb/releases/tag/python-v0.13.0 has been released it is supported therefore the project should be updated so that it uses lancedb version greater than 0.13. Also the tantivy dependency can be removed.