search

OpenAdaptAI / OpenAdapt

AI-First Process Automation with Large ([Language (LLMs) / Action (LAMs) / Multimodal (LMMs)] / Visual Language (VLMs)) Models
https://www.OpenAdapt.AI
MIT License
742 stars 98 forks source link

Explore client/server architectures: LMTP, LlamaIndex, etc. #427

Open abrichr opened 11 months ago

abrichr commented 11 months ago

Feature request

We want to understand how serving models might be useful in the context of OpenAdapt.

e.g. serve llama.cpp via LMTP with https://github.com/eth-sri/lmql/tree/main/src/lmql/models/lmtp

e.g. https://gpt-index.readthedocs.io/en/latest/

Motivation

No response

dianzrong commented 11 months ago

Thoughts here