search

matsengrp / vampire

🧛 Deep generative models for TCR sequences 🧛
Apache License 2.0
16 stars 4 forks source link

Batch norm #62

Closed matsen closed 5 years ago

matsen commented 5 years ago

Add batch norm to the network.

@krdav I'm intending on putting it after the activation function. See https://stackoverflow.com/a/45624249 for discussion. If you think before is better let me know.

matsen commented 5 years ago

Doesn't seem any better. Implemented in 2a8f05cf5e10d0fd93ac3f084832d3c4227176be as basic_bn and basic_bn_3 (3 layer version) models.

I'll leave the 62-batch-norm branch around.