search

hkust-nlp / AgentBoard

An Analytical Evaluation Board of Multi-turn LLM Agents
219 stars 22 forks source link

[Refactor Request] Structured objects/typing #3

Closed logan-markewich closed 2 months ago

logan-markewich commented 7 months ago

Amazing work here! Having tests for agents is super valuable.

Just a note to encourage contributions from other developers -- it would help to have more typing, as well as base classes for things.

Trying to wrap llama-index in this framework has been slightly confusing, since there are no types and I have to read a ton of code and debug line-by-line to see what the inputs to things are :)

leoozy commented 6 months ago

Thank you very much. We will add comments for the base classes. In the meantime, you can refer to LLM and agent for adding new models/ typing.

logan-markewich commented 6 months ago

Thanks! 🚀