-
### 🚀 The feature, motivation and pitch
I am looking to assess the performance of vllm for speculative decode, but I have been unable to find an offline benchmark script similar to [benchmark_latency…
-
**Objective**:
Develop a testing application to thoroughly exercise the CRTM model under various configurations (e.g., Cloud LUTs, multiple profiles) and collect performance metrics.
**Metrics to …
-
Hello!
Thank you for creating a wonderful repository. I would like to start translation about these four documents in Korean.
- [x] [Philosophy](https://github.com/huggingface/diffusers/blob/main/…
-
Currently, `pipboard` can display numerical data(accuracy, recall rate, and losses).
However, most model evaluation process requires images (I.E. generated image in GAN model) or tables (I.E. Confu…
-
Hi again!
I'm wondering if you have considered evaluating MP-SENet with _Perceptual Constrast Stretching_? (PCS, see https://github.com/RoyChao19477/PCS)
I've seen it improve many models' performanc…
-
warning: not compiled with GPU offload support, --n-gpu-layers option will be ignored
warning: see main README.md for information on enabling GPU BLAS support
Log start
main: build = 2854 (70c312d)…
-
### Prerequisite
- [X] I have searched [Issues](https://github.com/open-compass/opencompass/issues/) and [Discussions](https://github.com/open-compass/opencompass/discussions) but cannot get the expe…
-
- [ ] [Evaluating Text Generation Quality: Introducing GPTScore](https://paperswithcode.com/paper/gptscore-evaluate-as-you-desire)
# Evaluating Text Generation Quality: Introducing GPTScore
**Snippe…
-
Hi,
First of all, thanks for making your great code and models available.
I am currently trying out two of your models (MP-CNN and VDPWI) and noticed that when evaluating trained models (via --skip…
-
This data element is necessary to evaluate the exception:
> 1) If it can be demonstrated to the satisfaction of the rating authority that the building orientation is dictated by site consideration…