Test and evaluate the quality of response after ingestion of astro cli docs

astronomer / ask-astro

An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer

https://ask.astronomer.io/

Apache License 2.0

196 stars 47 forks source link

Test and evaluate the quality of response after ingestion of astro cli docs #191

Closed sunank200 closed 11 months ago

sunank200 commented 11 months ago

After ingestion of astro cli docs we need to run the same test plan again and evaluate the results.

Depends on: #190

sunank200 commented 11 months ago

This can be tested with #161 #165 #166

sunank200 commented 11 months ago

Also this can be tested: #164

vatsrahul1001 commented 11 months ago

I have tested the Astro CLI, and its responses have improved. Additionally, sources from Astro CLI ingested docs are now evident. Overall, everything looks good; however, I have observed that Astro CLI docs are starting to appear in some Astro SDK and Astronomer Providers sources."

Results