search

advanced-stack / py-llm-core

A pythonic library providing light-weighted interface with LLMs
MIT License
103 stars 8 forks source link

correct system font format #7

Closed kousun12 closed 7 months ago

kousun12 commented 7 months ago

addresses https://github.com/advanced-stack/py-llm-core/issues/6

correct type is 

class ChatCompletionRequestSystemMessage(TypedDict):
    role: Literal["system"]
    content: Optional[str]

https://github.com/abetlen/llama-cpp-python/blob/main/llama_cpp/llama_types.py#L180