search

Not-Diamond / notdiamond-python

Not Diamond Python SDK
54 stars 8 forks source link

T7 update custom router eval data ENG-1396 #51

Closed r0ymanesco closed 1 week ago

r0ymanesco commented 1 week ago

As per the proposal doc, this PR adds cost and latency to the custom router eval routine.

github-actions[bot] commented 1 week ago

Coverage report

Click to see where and how coverage changed

FileStatementsMissingCoverageCoverage
(new stmts)		Lines missing
  notdiamond/llms
  config.py
  notdiamond/toolkit
  custom_router.py 347-348
  notdiamond/toolkit/litellm
  main.py
  tests/test_toolkit
  test_custom_router.py
Project Total  

This report was generated by python-coverage-comment-action