Feature/add topk search

dleemiller / WordLlama

Things you can do with the token embeddings of an LLM

MIT License

1.39k stars 47 forks source link

Closed dleemiller closed 4 months ago

dleemiller commented 4 months ago

adds filter(), topk() to inference class
refactors similarity functions to be checked against binary flag and use vector_similarity to select
fixes some binary model support issues
fixes tests