[Roadmap] AIOS Roadmap Q2 2024

[Tata0703]

This document outlines the features in the AIOS roadmap for Q2 2024. Please feel free to discuss and contribute to the specific features through related Issues or PRs, and add any other topics you'd like to talk about in this issue.

Device Support & LLM inference acceleration integration

• [x] ollama support: https://github.com/agiresearch/AIOS/pull/108
• [x] vllm support on GPU

Agent configuration

• [x] move agent creation logic from AIOS to OpenAGI
• [x] enable tool callings
  • [x] chatgpt-based tool calling https://github.com/agiresearch/OpenAGI/pull/50 https://github.com/agiresearch/AIOS/pull/116
  • [x] open-sourced llm tool calling
• [x] add an agent (travel agent) with more tool callings
• [ ] add a RAG agent
  • [ ] add a RAG agent from scratch, @scottyaohk
  • [ ] add a llamaindex -based RAG agent, @zzfoo
  • [ ] add a langchain -based RAG agent, @BRama10
  • [ ] add a langgraph -based RAG agent
• [ ] add a ReAct agent
• [ ] add an agent with self planning and code interpretation for action execution

More & better documentation

• [x] add evaluation script and add agent-level and request-level evaluation metrics
  • [x] https://github.com/agiresearch/AIOS/pull/93
  • [x] https://github.com/agiresearch/AIOS/pull/96
  • [x] https://github.com/agiresearch/AIOS/pull/100
• [x] improve documentation and environment set up
  • [x] https://github.com/agiresearch/AIOS/pull/97
  • [x] https://github.com/agiresearch/AIOS/pull/98
  • [x] https://github.com/agiresearch/AIOS/pull/99
• [x] add more benchmarks
• [x] update the architecture diagram of AIOS

Better demo

• [ ] restructure demo output
• [ ] add visualize.py script to visualize agent task execution

Streaming output

• [ ] change to streaming output
• [ ] enable the context switch and interrupt for closed-source llm

Testing

• [ ] modify unit test
  • [x] https://github.com/agiresearch/OpenAGI/pull/48
  • [x] https://github.com/agiresearch/AIOS/pull/113
• [ ] add integration test
• [ ] add github workflow https://github.com/agiresearch/AIOS/issues/134

Package & Documentation

• [ ] release OpenAGI and AIOS Python packages
• [ ] add documentation for OpenAGI and AIOS
• [ ] add video tutorials for developers

[itsthemoon]

hi, I am interested in working on: add an agent with more tool callings

[dongyuanjushi]

A travel agent can be considered by calling multiple search tools (hotels, flights, restaurants). Or it is possible to come up with other agent, which will call multiple tools during execution. A sub-channel can be created for follow up @itsthemoon .

[itsthemoon]

A travel agent can be considered by calling multiple search tools (hotels, flights, restaurants). Or it is possible to come up with other agent, which will call multiple tools during execution. A sub-channel can be created for follow up @itsthemoon .

I created an issue here and I am currently working on the implementation.

[ArnoldIOI]

I'll be working on the langgraph -based RAG agent. I've opened a new issue here.

[zzfoo]

I'm working on the llamaindex -based RAG agent. Here is the issue.