SciSharp / LLamaSharp

A C#/.NET library to run LLM (đŸ¦™LLaMA/LLaVA) on your local device efficiently.
https://scisharp.github.io/LLamaSharp
MIT License
2.72k stars 351 forks source link

Improve `LLamaEmbedder` #889

Closed martindevans closed 2 months ago

martindevans commented 3 months ago

Description

The LLamaEmbedder at the moment does not expose all of the embedding capabilities of llama.cpp.

Currently:

Improvements:

Random things to consider in no particular order:

martindevans commented 3 months ago

@Lyrcaxis Some notes on LLamaEmbedder improvements, as discussed in Discord.

martindevans commented 3 months ago

See #902 for a start on some of this.