search

0-5788719150923125 / ode

omniscient deterministic engine
MIT License
6 stars 0 forks source link

Integrate a validation set #2

Open Vectorrent opened 2 months ago

Vectorrent commented 2 months ago

The challenge is with how to split the data, when the vast majority of it is being sampled stochastically, today.

Vectorrent commented 2 months ago

I added some very basic (and kind of ugly) validation code. The only data that supports it currently is the Phi dataset.

Because Phi has just 2 batches, I assigned one to training data, and the other to validation data.

I also implemented a simple, deterministic random number generator, so that I could initialize weights and iterate over data in a reproducible fashion.

There are likely to be things I missed, so we'll leave this issue open for a while.