Snowflake-Labs / sfguide-frosty-llm-chatbot-on-streamlit-snowflake

An LLM-powered Streamlit chatbot for data exploration and question answering on Snowflake
https://developers.snowflake.com/demos/data-exploration-llm-chatbot/
Apache License 2.0
121 stars 82 forks source link

Frosty CHatbot #28

Open 007ekho opened 8 months ago

007ekho commented 8 months ago

@sfc-gh-jcarroll

Hello, I have observed that when the LLM makes a call to the snowflakes database for Table. The output from the LLM is quite different from the original data in the snowflakes database.

Furthermore when you run the same Sql output on the LLM Streamlit interface on the Snowflakes platform. The results are totally different. the are similar relative to context showing that the LLM is aware of the original data structure but ends up transforming its output.

sfc-gh-jcarroll commented 8 months ago

Hi @007ekho, can you provide a more detailed description / example of what you are talking about? It's difficult to investigate based on the information provided. Thank you!