The use and application of chat format mimics the one in llama.cpp, but it's pretty bad to the point of being useless.
We want to support user-named roles is possible and more stream tweaks.
For now we will remove the use of chat format in llama instances, redesign, and add it externally through local llama. Until then we'll only use simple chat formats
iboB
commented
1 month ago
The use and application of chat format mimics the one in llama.cpp, but it's pretty bad to the point of being useless.
We want to support user-named roles is possible and more stream tweaks.
For now we will remove the use of chat format in llama instances, redesign, and add it externally through local llama. Until then we'll only use simple chat formats