-
### System Info
0.0.40 shipped the first version of embedding quant.
`--embedding-dtype int8`
This Issue is looking for testers, to verify the real life performance of these features at real da…
-
We need to benchmark ALR against other search methods, as well as have a test benchmark to see if system parts work working.
Lets look up recommended methods for benchmarking.
We will need to ch…
-
### Search before asking
- [X] I have searched the YOLOv8 [issues](https://github.com/ultralytics/ultralytics/issues) and [discussions](https://github.com/ultralytics/ultralytics/discussions) and fou…
-
Currently, we only run for an arbitrary pair of problem sizes. Running for all sizes from 100 to 1000 with a step of 1 is probably too much resource-wise, so some middle ground needs to be found.
-
```
**http2load**
finished in 65.00s, 25725.23 req/s, 29.04MB/s
requests: 1543514 total, 1543514 started, 1543514 done, 1543514 succeeded, 0 failed, 0 errored, 0 timeout
status codes: 1543477 2xx,…
-
The instructions are [here](https://github.com/utahplt/static-python-perf/tree/main/Benchmark/django_sample). It simply renders a graphic at the designated endpoint (`/myapp`) - taking inspiration fro…
-
- [ ] Finalize the plan to benchmark rnaaln workflow
some ideas: 1. qc metrics; 2. rpkm calls; 3. splice junction statistics
- [ ] Benchmark rnaaln workflow
-
It would be nice to set up https://github.com/marketplace/actions/continuous-benchmark for the compiler repo like e.g. @DZakh is doing it for https://github.com/DZakh/rescript-schema.
-
When we are on cloud (e.g., Fornax)
1. Benchmarking the speed in comparison to local cluster
2. Benchmark scaling, i.e,. speed as number of workers, in comparison to local cluster
-
Currently we benchmark:
BLAS level 1
- ddot
- ?nrm2
- ?axpy
BLAS level 3
- ?gemm
- ?syrk
LAPACK:
- ?gesv (`linalg.solve`)
- ?gesdd (`linalg.svd`)
- ?syev (`linalg.eigh`)
…