search

carverauto / threadr

🌎 OSS Real-time AI Data Analysis with GraphDB integration. 🔍
Apache License 2.0
16 stars 1 forks source link

QA: How many PagerDuty alerts have been fired over the last month and what was the team split? #81

Closed mfreeman451 closed 2 months ago

mfreeman451 commented 2 months ago

The LLM is choking on this a bit, when I add an example query in with the other queries that would be the correct way to create this cypher, it breaks all the QA (question-answering) before it.

The joys of working with infantile LLMs.

One possible solution is to just create a special tool that performs this query either using a (fake) pagerduty API, or a special tool that does a CypherQAChain query using a different prompt.

mfreeman451 commented 2 months ago

turns out we just needed a better prompt, we were asking "how many" and it kept doing a count..