abetlen / llama-cpp-python

Python bindings for llama.cpp
https://llama-cpp-python.readthedocs.io
MIT License
8k stars 948 forks source link

Add support for croos-encoders #1611

Open perpendicularai opened 3 months ago

perpendicularai commented 3 months ago

Llama tokenizer

perpendicularai commented 3 months ago

That's different.

perpendicularai commented 3 months ago

As it cannot be used to predict scores for sentences.