Save/load `historic_embeddings` to/from disk - Githubissues

opentensor / validators

Repository for bittensor validators

https://www.bittensor.com/

MIT License

14 stars 9 forks source link

Save/load `historic_embeddings` to/from disk #121

Closed opentaco closed 1 year ago

opentaco commented 1 year ago

Save/load `historic_embeddings` to/from disk

Periodically saves historic_embeddings to disk via save_state.
15500 (history range) x 768 (embedding) x 32 bits = 47 MB (projected max size)
Loads historic_embeddings from disk via load_state upon validator start.
Fixes model load neuron_weights tensorization.