search

ymcui / Chinese-Mixtral

中文Mixtral混合专家大模型（Chinese Mixtral MoE LLMs）
https://arxiv.org/abs/2403.01851
Apache License 2.0
576 stars 42 forks source link

Add OpenAI API Demo #25

Closed ymcui closed 5 months ago

ymcui commented 5 months ago

Description

This PR adds OpenAI API demo, which is mostly adapted from the ones in Chinese-LLaMA-Alpaca-2.

Functionality is tested under A100 (40G) on Google Colab.

Note: vLLM backend is not supported in this version.

Related Issue

Close #22