-
-
**What would you like to be added/modified**:
Based on existing datasets, the issue aims to build a benchmark for domain-specific large models on KubeEdge-Ianvs. Namely, it aims to help all Edge AI a…
-
It would be nice to mark the benchmark logs as artifacts.
We could then write a script that would use GitHub CLI tool to download the artifacts of main branch and plot the benchmarks.
-
Hello 作者你好, 我正在复现 PowerInfer, 对比 llama.cpp 和 PowerInfer 的性能。在基准测试阶段我遇到了一些意料之外的结果。
# 环境
- 代码
- PowerInfer: commit: 2217e7fb8c2409f2d4927c5fe15fd6c9ef289e96
- llama.cpp: commit: 6bb4908a1715…
-
# Loading data
- [ ] some basic datasets
- [ ] custom dataset
- [ ] TimeEval format (https://timeeval.readthedocs.io/en/latest/)
# Model training
- [ ] encapsulation of models to be tested in a…
-
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Environment
```markdown
- Milvus version:master-20231001-0f14d182
- Deployment mode(standalone or cluster):st…
-
Hello nice library, i think i prefer the aesthetics to ts-pattern. I noticed that ts-pattern was benchmarked to have a pretty huge overhead, between 10x to 1000x. https://github.com/gvergnaud/ts-patte…
-
### OpenVINO Version
2024.1.0
### Operating System
Windows System
### Device used for inference
NPU
### Framework
Keras (TensorFlow 2)
### Model used
Custom
### Issue description
Consider a…
-
The repository misses check of performance.
Some tests should be added.
-
Ad documentation: Performance Benchmarks.
### Acceptance Criteria (mandatory to start implementation)
- [ ] Benchmarking metrics defined.
- [ ] Benchmarking code implemented.
- [ ] Results added to…