-
This issue reports the work done to evaluate the existing models.
The existing models are the following:
- sct_deepseg_lesion
- sct_deepseg -t seg_sc_ms_lesion_stir_psir
- sct_deepseg -t seg…
-
I was wondering how the trained models are intended to be evaluated. I don't believe that the paper states how many samples were used to compute the metrics. The code appears to give some indication b…
-
Thanks for your work!
I wonder if there are models pretrained for ETH-UCY in meter coordinates,cuz the models released online are in the name of xxx-pixel-multimodal-xxxx,or these can be also used fo…
-
Using openAI api might not be feasible for some environment, could someone provide any reference or example link on running evaluation with local LLM model/?
-
Hi prometheus team!
Thanks for the great work. Wondering when will the README in this section get updated?
https://github.com/prometheus-eval/prometheus-eval/tree/main/eval
Thanks.
-
I'm using [InspectAI](https://inspect.ai-safety-institute.org.uk/) to evaluate language models. In particular, I'm evaluating the benefits of structured text generation using Outlines with language mo…
-
### 🚀 The feature, motivation and pitch
The peft (https://huggingface.co/docs/peft) and adapters (https://huggingface.co/docs/hub/adapters) libraries are add-ons for transformers and popular for adap…
-
### Anything you want to discuss about vllm.
Can vLLM consider support multiple models on the same vLLM instance?
We are evaluating using vLLM for large scale LLM inference serving. But we are con…
-
could you please list these jailrbeak method paper or github,i can't find them
query_attak, xidian
thank u very much
-
Greetings,
I searched the documentation but couldn't find anything regarding the argument. I may have lost it so please point me in the right direction if that's the case.
After evaluating the mo…