Open pan3793 opened 1 year ago
can i work on this issue? PLease assign me
@rose2221 thanks for your passion, may I ask do you have an estimation of when to complete the task? Since this is a challenging task, I would like to see some design and implementation steps before the task assignment.
Additional Context about 2023 Kyuubi Code Contribution Program
@rose2221 Hey buddy, I'm interested in this task as well. Can we do it together?
Code of Conduct
Search before asking
Describe the subtask
Currently, the Kyuubi supports Chat engine by invoking the ChatGPT online open API
But, is there any chance we can add a built-in offline ChatGPT engine? The answer is YES.
There is a project https://github.com/karpathy/nanoGPT which can train the GPT-2 model.
So, the basic idea is, training a GPT-like model, and Kyuubi Chat engine invoking this model to answer the question.
There are some specific questions:
Also, there is another interesting project https://github.com/ggerganov/llama.cpp
Parent issue
https://github.com/apache/kyuubi/issues/4549
Are you willing to submit PR?