Closed William-Gao1 closed 2 months ago
Title. I have tested this on prod. No support for vllm openai server mode since I want to get this out today, however the non-openai mode has the same api as openai mode.
BT-12120 [Model Library / Truss Example] add support for Pixtral
linear[bot]
commented
2 months ago
Title. I have tested this on prod. No support for vllm openai server mode since I want to get this out today, however the non-openai mode has the same api as openai mode.