search

AIAnytime / Medical-Mixture-of-Experts-LLM

Medical Mixture of Experts LLM using Mergekit.
MIT License
20 stars 8 forks source link

Medical-Mixture-of-Experts-LLM How can i run this model in chainlit or streamlit #1

Open ayub567 opened 8 months ago

ayub567 commented 8 months ago

Dear Sir,

How can i run this model in chainlit or streamlit, please share the source code.

Thanks

mahimairaja commented 3 months ago

@ayub567 Merge the model, save it locally or push it to HF hub.

And using the transformers pipeline, load the model and add it to your streamlit codebase