Generate Vectors - Githubissues

ijyliu / data-engineering-project

Building and benchmarking a vector similarity search and retrieval augmented generation (RAG) system with Milvus

0 stars 0 forks source link

Closed ijyliu closed 7 months ago

ijyliu commented 8 months ago

Updated March 14, 2023

[x] Get documents (tosdr)
[x] Convert to ASCII
[x] Sentence tokenize
[x] Insert company name at the front of every sentence (company name can be read in from the filename).
[x] Run through Mixedbread embedding model

ijyliu commented 7 months ago

mixedbread embeddings now available