I'm not having a ton of success with the current templates. I'm guessing there's a way we can fake the system prompt with the chat template but it needs some experimentation. It doesn't look like there's an obvious way to do system prompt but maybe it could be passed as a first message.
For example we could try this template...
Alice: [System prompt]
Bob: OK, I will follow these instructions.
Alice: [user's first message]
Bob:
...
psugihara
commented
2 months ago
I'm not having a ton of success with the current templates. I'm guessing there's a way we can fake the system prompt with the chat template but it needs some experimentation. It doesn't look like there's an obvious way to do system prompt but maybe it could be passed as a first message.
For example we could try this template...
Alice: [System prompt] Bob: OK, I will follow these instructions. Alice: [user's first message] Bob: ...