-
Implement methods listed in as similarity module https://vlachosgroup.github.io/AIMSim/implemented_metrics.html. Please add detailed documentation to show which similarity functions is corresponding t…
-
### What is the issue?
I am using the ollama Python library for all the results I am getting.
As I create embeddings using ollama.embed() I get progressively worse embeddings as the batches are …
-
The Semantic Answer Similarity (SAS) metric (https://arxiv.org/abs/2108.06130) employs pretrained encoders to gauge the semantic similarity between two types of texts: predictions and references. This…
-
Description: I have tested a set of images using your model weights and performed N
matching based on cosine similarity. I followed the code structure below:
# Sample code for N:N matching using…
-
1. Did you guys perform any quantification of the difference between vocabularies before remediating it in the paper? To say Mistral 7B has different vocabulary than Llama or TinyLlama, how much is th…
-
This issue is for capturing integration with a geospatial agent (see https://github.com/Urban-Analytics-Technology-Platform/geollm/issues/2 and https://github.com/Urban-Analytics-Technology-Platform/g…
-
Hi, @youngsheen thank you for the amazing work. May I ask several questions:
1. Are the four WavTokenizers in Table 4 trained by yourself or released by the WavTokenizer's authors?
2. What do you m…
-
Dr. Yahui Long,
Sorry to bother you. I have a couple of questions and issues regarding the calculation of two unsupervised metrics. I have read your SpatialGlue paper and code, but I'm encountering…
-
We currently leverage some llm based evaluation metrics from ragas: https://github.com/explodinggradients/ragas
namely, `llm_context_precision`, `llm_context_recall` and `llm_answer_relevance` in thi…
-
[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug.
Hi experts,
I use the answer_correctness as the metric, but it failed due to **A…