Closed jhen0409 closed 3 months ago
Support convert OpenAI API compatible message ([{ role, content }, ...] and then llama_chat_apply_template.
[{ role, content }, ...]
llama_chat_apply_template
context.model.isChatTemplateSupported
context.completion(...)
messages: RNLlamaOAICompatibleMessage[]
context.getFormattedChat(messages: RNLlamaOAICompatibleMessage[]): string)
chatml
context.completion
Support convert OpenAI API compatible message (
[{ role, content }, ...]
and thenllama_chat_apply_template
.context.model.isChatTemplateSupported
context.completion(...)
: Addmessages: RNLlamaOAICompatibleMessage[]
in paramscontext.getFormattedChat(messages: RNLlamaOAICompatibleMessage[]): string)
chatml
as formatcontext.completion
also uses it to convert messages to prompt