[Feature]: Is Kirin suitable as a chatbot for website visitor questions on open source project documentation?

[leecalcote]

Contact Details(optional)

You can find me in https://slack.layer5.io, if you'd like to chat.

What feature are you requesting?

A question, perhaps, for @Aisuko: Is Kirin suitable as a chatbot for website visitor questions on open source project documentation, like https://docs.meshery.io? Or does this require a fair bit of model training and hosting effort?

More context: https://github.com/meshery/meshery/issues/12777 // @vishalmvivek

[Aisuko]

Hi sir. @leecalcote Long time no see.

Yes, we can do that. Our target is cost-effective AI solution for all the open-source projects. We use RAG technique and it has some benefits I mentioned in https://github.com/meshery/meshery/issues/12777#issuecomment-2505044555.

For the model training, I think we can investigate the it in the second step. For example, if we found that RAG is not enough for us. We can deign fine-tuning and evaluation pipeline for the model which means we do not need to spend any resources on the fine-tuning tasks.

There are two options,

• 1.self-host LLM(local ai) which needs cloud environment to host the LLM.
• 2.Third party platform(API call) like Amazon.