dora-rs / dora

DORA (Dataflow-Oriented Robotic Architecture) is middleware designed to streamline and simplify the creation of AI-based robotic applications. It offers low latency, composable, and distributed dataflow capabilities. Applications are modeled as directed graphs, also referred to as pipelines.
https://dora-rs.ai
Apache License 2.0
1.58k stars 95 forks source link

Dora openai server example #676

Closed haixuanTao closed 1 month ago

haixuanTao commented 1 month ago

You will find in this pull request a quick implementation of an openAI server makes it possible to make request from an openai endpoint client and receive it within the dataflow.

Note that I have only implemented chat completion and this is still experimental.

Get started with:

cd examples/openai-server
dora build dataflow.yml
dora start dataflow.yml

# In a separate terminal
python openai_api_client.py