search

synapse-alpha / mirror-neuron

Experiments on bittensor reward models to find exploits
BSD 2-Clause "Simplified" License
1 stars 0 forks source link

Investigate to merge with live validators on bittensor #65

Open steffencruz opened 1 year ago

steffencruz commented 1 year ago

There is interest to port a minimal version of this repo into bittensor so that we can track validators and the network in general.

It seems like the simplest way to do this is to save the forward events either by pickling to history queue or by writing the pre existing event logs to disk. There is also interest in reusing the data visualizations and analysis capabilities of this repo, and so we should focus on making the analysis stage of experiments in this repo stable.

This will provide a direct path to creating value out of this repo and so should be carefully considered.

Estimated size of pickled object

~500 kb for an experiment with 1000 events, so expected pickled file size would be around 1MB/2000 events (or forward passes).

steffencruz commented 1 year ago

@joeylegere has a slight preference for pickling.

steffencruz commented 1 year ago

Next step for this would be to modify neuron class so that it pickles the event history intermittently and then we load that pickle file into mirror neuron as an experiment.

steffencruz commented 1 year ago

We can test this by running a validator on testnet. I will need support on this @ifrit98 .

ifrit98 commented 1 year ago

We can test this by running a validator on testnet. I will need support on this @ifrit98 .

Yep. Can help out with that. Vune caught an issue we have been having attempting to use the testnet but the metagraph being empty and threw up a PR. Not sure if it's merged yet, but the fix is simple in case we run into errors.

https://github.com/opentensor/bittensor/pull/1318/files

steffencruz commented 1 year ago

thanks