search

AgentOps-AI / agentops

Python SDK for agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks like CrewAI, Langchain, and Autogen
https://agentops.ai
MIT License
1.22k stars 97 forks source link

feat: add gptlint #199

Open transitive-bullshit opened 2 months ago

transitive-bullshit commented 2 months ago

📥 Pull Request

📘 Description

This PR is an example of how to add gptlint to AgentOps.

🔄 Related Issue (if applicable) https://github.com/gptlint/gptlint/issues/17

🎯 Goal This PR ads a single gptlint rule aimed at enforcing correct spelling and grammar.

🔍 Additional Context Previous confo w/ Alex.

🧪 Testing CleanShot 2024-05-07 at 18 35 29@2x

areibman commented 2 months ago

Maybe I'm just running it wrong, but it's not catching English errors I've intentionally introduced:

(Cached run, but results still the same):

(env) (base) ➜  agentops git:(feature/gptlint) ✗ npx gptlint -C README.md
Linter tasks { numFiles: 1, numRules: 1, numTasks: 1 }
Linter stats; total cost $0.00 {
  model: 'gpt-4-turbo',
  weakModel: 'gpt-3.5-turbo',
  numModelCalls: 1,
  numModelCallsCached: 0,
  numPromptTokens: 2974,
  numCompletionTokens: 71,
  numTotalTokens: 3045,
  lintDuration: '2s'
}

no lint errors 🎉
✔ Preprocessing 1 files and 1 rules