Ask Astro || Sources references documents are not showing in Top 3 for questions

astronomer / ask-astro

An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer

https://ask.astronomer.io/

Apache License 2.0

196 stars 47 forks source link

Ask Astro || Sources references documents are not showing in Top 3 for questions #169

Closed vatsrahul1001 closed 10 months ago

vatsrahul1001 commented 12 months ago

While Testing the Hybrid search I noticed a ranking of sources reference documents might have degraded, one observation is we now have some irrelevant issues stating showing

Before hybrid

After hybrid

davidgxue commented 10 months ago

The hyrbid search PRs and issues linked are the old attempt implementation which was not necessarily correct or working as intended. This issue of source reference docs not showing in top 3 have been resolved by a new implementation of Hybrid Search + Reranker + LLM Chain Filter in this PR https://github.com/astronomer/ask-astro/pull/247, and was tested here in this issue https://github.com/astronomer/ask-astro/issues/253.

Thus, closing this issue as it is resolved/no longer relevant.