Closed mattjcly closed 5 months ago
From https://huggingface.co/microsoft/Phi-3-mini-128k-instruct
System prompt was causing some weird tokens to be produced for at least the 4k model (it was only shown by microsoft for the 128k context version), so I removed it and the output is clean. 128k is not yet in GGUF for me to test that one.
From https://huggingface.co/microsoft/Phi-3-mini-128k-instruct
System prompt was causing some weird tokens to be produced for at least the 4k model (it was only shown by microsoft for the 128k context version), so I removed it and the output is clean. 128k is not yet in GGUF for me to test that one.