Integrate Ask-astro prod and Ask-Astro dev with Langsmith

astronomer / ask-astro

An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer

https://ask.astronomer.io/

Apache License 2.0

192 stars 47 forks source link

Integrate Ask-astro prod and Ask-Astro dev with Langsmith #66

Closed sunank200 closed 11 months ago

sunank200 commented 11 months ago

[x] Integrate Ask-astro prod slackbot with Langsmith
[x] Integrate Ask-Astro dev slackbot with Langsmith
[x] Document the change.
[x] Create a separate project for dev
[x] Debug why sending through slack cannot generate correct result on Langsmith

Lee-W commented 11 months ago

I think for this one, we already finished the integration and project creation but we might need to check why the slack part doesn't work as expected. Currently, asking on slack will only send the first (or previous?) question to langsmith instead of the current one. We guess this might be related to cache

Lee-W commented 11 months ago

@sunank200 I've tested with ask-astro-local (the workspace I created this morning) and ask-astro-dev and it seems I'm not able to replicate this issue again. My guess is it might be a langsmith issue. I'll close this issue for now. But please reopen it if you feel I miss anything.