search

UTMIST / oneshot-rs

A Rust implementation of Siamese Neural Networks for One-shot Image Recognition for benchmarking performance and results.
MIT License
1 stars 0 forks source link

Enable Training/Testing Set Serialization #3

Closed rhubarbwu closed 3 years ago

rhubarbwu commented 3 years ago

The augmented dataset must be formatted in a similar fashion to the MNIST dataset so that we can use the rust-autograd example (see mnist_data.rs and cnn_mnist.rs).

This might be complicated because our dataset resides in three layers of directories, so perhaps packing everything into a single object might be difficult. We may look to packing a single object per each language, or each language's character directory.

Veyron2121 commented 3 years ago

Possible Solution

  1. Take sampled filenames from src/sample/mod.rs
  2. Get image data for each file and make a 2 (105 105) bit array, plus 1 for the label
  3. Serialize that using gzip?...
rhubarbwu commented 3 years ago

Made redundant by https://github.com/UTMIST/oneshot-rs/commit/376acd626e4ceade7c54d8cc3ea7ba5ad3328810.