-
Establish e2e benchmarking framework by using the created `reportvision-dataset-1`
we want to automate the measurement or accuracy and speed for running that dataset into the ocr pipeline
**Acceptanc…
-
Currently the benchmarking workflow is broken, not working, does not compile at all, even if after fighting with the compiler and fixing all the issues and make it compiles, it does not run and return…
-
Create a standardized form testing dataset based on a readily available dataset, this will be used for building a standard benchmark for ReportVision
**Acceptance Criteria**
- The dataset should…
-
## Description
Design and implement an out of the box benchmarking framework for stencil based micro-services.
## Tasks
### 1. Research
- [ ] Design the framework - Research
- [ ] `wrk` for HTT…
-
A great initial effort was made by @DBCerigo @TNTran92 @alex-hh to create a user-friendly sktime benchmarking interface for quick univariate forecasting benchmarks. The decision to include Kotsu as pa…
-
-
We need some mechanism that will reduce the current noise in our benchmarks to a minimum.
-
That would be ideal to have some minimal benchmarking framework. As of today, much benchmarks were carried out manually, but having a better/automated way to run benchmarks would make our life easier …
-
Benchmarking currently uses a statistical confidence to determine the number of iterations. However, this can lead to extremely long-running benchmarks. Hence, I suggest to limit the number of iterati…
-
Yet another category of libraries and frameworks that are more tools than anything else: benchmarking frameworks. This won't be surprising at all, but let's start by mentioning our dear [Nonius](https…