Create notebook/script to generate embeddings for different models

Checkpoint-89 / llm

MIT License

2 stars 1 forks source link

Create notebook/script to generate embeddings for different models #2

Open erpic opened 1 year ago

erpic commented 1 year ago

it would be nice to be able to generate embeddings (for visualization using projector.tensorflow.org) using different hf models

erpic commented 1 year ago

would be nice if that could also somehow interafce with the openai api so we could compare their embeddings to others

Checkpoint-89 commented 1 year ago

Hi @erpic, this is indeed included in the roadmap. We are currently in the process of collecting and understanding various use cases for embeddings and should implement this very soon.