impel-intelligence / dippy-bittensor-subnet

MIT License
46 stars 18 forks source link

Recommend new score evaluation method #82

Closed torquedrop closed 2 weeks ago

torquedrop commented 2 weeks ago

I recommend using the truncated mean scoring system. In this system, the highest and lowest scores are removed, and the average of the remaining scores is used to calculate the final result. To save time during score evaluation, consider reducing the sample size to 1024 or 512 for each scoring instance, and limiting the number of score calculations to 5.

donaldknoller commented 2 weeks ago

Closing as duplicate of https://github.com/impel-intelligence/dippy-bittensor-subnet/issues/80