search

gnosis / prediction-market-agent-tooling

Tools to benchmark, deploy and monitor prediction market agents.
GNU Lesser General Public License v3.0
15 stars 2 forks source link

Expand benchmarking metrics #167

Open gabrielfior opened 5 months ago

gabrielfior commented 5 months ago

It would also be interesting to expand the benchmarking metrics to include other useful information, e.g. level of confidence on the predictions the agent is doing.

@evangriffiths @kongzii feel free to add more input here as to which metrics make the most sense.

kongzii commented 5 months ago

Confidence is already there, but otherwise feel free to add any metric you deem interesting.

Screenshot of current benchmark:

Screenshot by Dropbox Capture