Not-Diamond / notdiamond-python

Not Diamond Python SDK
54 stars 8 forks source link

fix rag_workflow run in each trial #55

Closed r0ymanesco closed 1 week ago

r0ymanesco commented 1 week ago

Move the evaluation_dataset creation to _outer_objective in order to reinitialise on each objective computation

github-actions[bot] commented 1 week ago

Coverage report

Click to see where and how coverage changed

FileStatementsMissingCoverageCoverage
(new stmts)
Lines missing
  notdiamond/llms
  client.py
  notdiamond/toolkit
  langchain.py
  notdiamond/toolkit/litellm
  main.py
  notdiamond/toolkit/rag
  workflow.py
  tests/test_components/test_llms
  test_llm.py
  tests/test_toolkit/langchain
  test_unit.py
  tests/test_toolkit/rag
  test_example_workflow.py
  test_workflow.py
Project Total  

This report was generated by python-coverage-comment-action