How to add chatRTX support for edge model minicpm

NVIDIA / ChatRTX

A developer reference project for creating Retrieval Augmented Generation (RAG) chatbots on Windows using TensorRT-LLM

Other

2.63k stars 299 forks source link

How to add chatRTX support for edge model minicpm #75

Open LDLINGLINGLING opened 2 months ago

LDLINGLINGLING commented 2 months ago

I am a member of the openbmb lab, and I would like to add chartRTX support for openbmb/minicpm, which is one of the best mini models in China. How can I do this?

anujj commented 2 months ago

Currently we don't have a openbmb/minicpm support in trt-llm backend. Let me check internally and get back to you.

LDLINGLINGLING commented 1 month ago

Thank you very much, looking forward to your reply