-
We need a mechanism to cache identical and similar requests to the LLM. The Python de-facto solution is https://github.com/zilliztech/GPTCache.
-
As we continue enriching our data we need to be able to reliably match the text of hadith units from different sources. At its core, this is a simple string matching task, and something very simple li…
-
Similar to what is done now for similar image search.
-
In the `blip2_feature_extractor` notebook, I observed that the model is capable of embedding both textual and visual content into normalized vectors, enabling the comparison of cosine similarity betwe…
-
Initial Brainstorm Joe & Liz (Dec 1):
1. Utilizing strictly semantic similarity (PhraseBERT or SentenceBERT w/ interesting chunking)
2. Frame as LM paraphrasing task - if a sentence could be "para…
-
Hi all
The data comes in a ~3 Gb json file here:
https://www.yelp.com/dataset/download
I found a json to csv here:
https://github.com/Yelp/dataset-examples
To make the data into a more approa…
-
What kind of model should be used for embedding? When I use **nomic-embed-text-v1.5.f32.gguf**, it will report protected memory, while when I use **tinyllama-1.1b-chat.gguf**, it can run normally. How…
-
Collecting semantic-text-similarity
Using cached semantic_text_similarity-1.0.3-py3-none-any.whl (416 kB)
Collecting pytorch-transformers==1.1.0
Using cached pytorch_transformers-1.1.0-py3-none…
-
Note: Could be on different datasets.
-
Hi,
Thanks for your good work,
For UniXcoder, the example that measures the similarity between NL-PL pairs you showed is using encoder-only mode.
Is it possible that encoder-decoder mode can …