search

microsoft / aici

AICI: Prompts as (Wasm) Programs
MIT License
1.87k stars 76 forks source link

vLLM integration #63

Open emrekiciman opened 5 months ago

emrekiciman commented 5 months ago

Creating an issue on aici to link to draft vLLM PR and discussion

https://github.com/vllm-project/vllm/pull/2888

Cc: @mmoskal

deoxykev commented 4 months ago

How far do you think before the work is merged? This is very exciting research.