13. Working Group Meeting

Simsso / NIPS-2018-Adversarial-Vision-Challenge

Code, documents, and deployment configuration files, related to our participation in the 2018 NIPS Adversarial Vision Challenge "Robust Model Track"

MIT License

10 stars 1 forks source link

13. Working Group Meeting #56

Closed ghost closed 6 years ago

ghost commented 6 years ago

Date: 3. Oct 2018 (aka. honeymoon)

@doktorgibson

[x] enablement tools #35
[x] get avc-test-model to work (docs here)
[x] training pipeline finalization #62

@FlorianPfisterer

[x] read wikipage of training pipeline
[x] develop #51 further (implement direct embedding value assignment + tests)
[x] make ResNet submittable #61

@Simsso

[x] read wikipage of training pipeline
[x] develop #51 further (in particular profiling #58)
[x] logger class #60
[x] virtual batch sizes #64
[x] dotp norm order #63

Simsso commented 6 years ago

General Items up for Discussion

Decision on C++ implementation vs. virtual batch size method; see profiling issue #58
Embedding vector sparsity issue and potentials solutions https://github.com/Simsso/NIPS-2018-Adversarial-Vision-Challenge/issues/51#issuecomment-425974978
Merging of working code
- vq-layer branch release of vq_layer v1.0.0
- vq-resnet branch alongside with submittable-resnet
Planning / naming of requirements for the enablement tools
Creation of an issue for structured experiments with the current VQ layer (for instance, we still don't know what an appropriate magnitude is for the learning rate, alpha, beta, and gamma)

Simsso commented 6 years ago

Minutes

Pipeline works
Logging to a file inside of the Docker container (both errors and info logs)
avc-test-model due today
Enablement tools are work in progress
Replacement feature is implemented and tested
Replacement features does not work work with virtual batches and replaces with validation samples. Needs to be improved #70.
Submission documented and "implemented"; not tested yet (due today)
Profiling with equations to compute memory requirements
Logger class implemented
Virtual batch size feature implemented
Cosine distance is not completed, due until next time

Simsso commented 6 years ago

Due Today

[x] Logger class mini thing
[x] Merge accumulator #67
[x] PR for submittable ResNet
[x] Local testing avc-test-model
[x] Merge v0.1.0 of vq_layer #69
[x] Rename and open PR for resnet_base #72
[x] Submit to crowd.ai
[x] Telegram commands / enablement tools interface
[x] Plan structured experiments for the VQResNet
[x] Set up appointment for the next working group meeting

FlorianPfisterer commented 6 years ago

In terms of the structured VQResNet experiments: note we should add tf.flags for the parameters here as well. It's not very nice to hard-code them in the graph definition (referring to here).

Simsso commented 6 years ago

Hot-Fixes

Memory requirements https://github.com/Simsso/NIPS-2018-Adversarial-Vision-Challenge/commit/e7ac4ef7477dd464605ecf6563f7d3e761a4a079
Replacement feature is broken https://github.com/Simsso/NIPS-2018-Adversarial-Vision-Challenge/commit/f50dd652b9ae351ecd19280cd7b1fab162d87d5f
Batching was broken https://github.com/Simsso/NIPS-2018-Adversarial-Vision-Challenge/commit/72f9d996b08fea189417e4c97517dc718887ffbd