search

Marker-Inc-Korea / AutoRAG

AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation
https://auto-rag.com/
Apache License 2.0
2.81k stars 219 forks source link

[Feature Request] SGlang, the fast serving framework #898

Open skmanzg opened 1 month ago

skmanzg commented 1 month ago

Is your feature request related to a problem? Please describe.

This is kind of an 'FYI' for @vkehfdl1 from our previous brief coffee chat. You may simply close this issue if you are already fully aware of it.

Additional context

You may refer the sources below:

  1. the official GitHub repo
  2. reactions, reviews from the Korean community
vkehfdl1 commented 1 month ago

@skmanzg Thanks:) It is weird I cannot find sglang llama index integration. We will implement it soon.

Thanks:)