astronomer / ask-astro

An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer
https://ask.astronomer.io/
Apache License 2.0
192 stars 47 forks source link

Test and evaluate the quality of response after using new Weaviate providers after release of 1.3.0 #189

Closed sunank200 closed 9 months ago

sunank200 commented 10 months ago

After replacing taskflow API with the OSS weaviate hook we need to run the same test plan again and evaluate the results.

Depends on: #136

sunank200 commented 9 months ago

@vatsrahul1001 you can test the change as the latest ingestion with new weaviate provider is done for dev stackbot as per 246

vatsrahul1001 commented 9 months ago

Verified this LGTM, and I do not see any regression in sources and response

Results