hkust-nlp / AgentBoard

An Analytical Evaluation Board of Multi-turn LLM Agents
250 stars 26 forks source link

[Refactor Request] Structured objects/typing #3

Closed logan-markewich closed 5 months ago

logan-markewich commented 10 months ago

Amazing work here! Having tests for agents is super valuable.

Just a note to encourage contributions from other developers -- it would help to have more typing, as well as base classes for things.

Trying to wrap llama-index in this framework has been slightly confusing, since there are no types and I have to read a ton of code and debug line-by-line to see what the inputs to things are :)

leoozy commented 10 months ago

Thank you very much. We will add comments for the base classes. In the meantime, you can refer to LLM and agent for adding new models/ typing.

logan-markewich commented 10 months ago

Thanks! 🚀