-
Stackerdb needs a benchmark function to determine how long it takes all nodes to see an update.
*very* similar to how ping/traceroute works- the end result is we have an idea of how long it takes an…
-
Unable to download the datasets mentioned in repo ...same issue with GIST and Cohere datasets...share the dow…
-
### Description
Since we've edited benchmark tests and the benchmark testing framework to be able to be run in the current codebase, we have an opportunity to add tests to uncovered parts of the agen…
-
Hi GUICourse Team,
I’m testing GUICourse on **ScreenSpot** (a grounding benchmark) with this prompt, which is from the paper: `Please give me the grounding box of the "{element_description}".`
I…
-
Hi, I'm new to extism but find your project very attractive! Thanks!
I wonder what to expect in terms of performance, and is there a way to improve that?
I'm using tinygo to compile the was file…
-
**Is your feature request related to a problem? Please describe.**
Currently, performance benchmarks are run locally in an IDE or with a script. It would be nice to have a certain documented way to do…
-
## Description and context
We aim to conduct benchmark testing on the IP Graph precompile to validate its performance and scalability under various scenarios. This testing is crucial to ensure that o…
-
## Categories of Performance Tests
Performance tests can be divided into two main categories:
1. **Artificial Benchmarks**
2. **Real UMF Use Cases**
I intend to begin with **Artificial Bench…
-
Are there any standard sets of benchmark graphs on the web that we could use for testing? We would want them to be
- diverse: cover several structures and densities
- scalable: go from small to la…
-
master branch not working out of the box as specified in documentation:
https://insigneo.github.io/pFIRE/_sources/developer_docs/testsuite.rst.txt
on docker centos:01 the error is for pip instal…