airockchip / rknn-llm

Other
347 stars 29 forks source link

Embeddings generation not supported? #66

Open woutermans opened 3 months ago

woutermans commented 3 months ago

Hi there! I'm trying to use rkllm for generating embeddings of my codebase using something like nomic-embed, but I've hit a roadblock. As the title suggests, I'm having trouble finding any information on how to generate embeddings with this library.

I've checked the documentation and codebase, but it seems like there's no support for this functionality. Am I missing something? Have I overlooked an important detail?

If that's the case, would it be possible to add support for embedding generation in the future? I think this feature could really enhance the usability of rkllm for certain use cases.