[2020]Whitening and second order optimization both destroy information about the dataset, and can make generalization impossible

書誌情報

論文リンク

https://arxiv.org/abs/2008.07545

著者/所属機関

Neha S. Wadia University of California, Berkeley neha.wadia@berkeley.edu Daniel Duckworth Google Brain duckworthd@google.com Samuel S. Schoenholz Google Brain schsam@google.com Ethan Dyer Google Brain edyer@google.com Jascha Sohl-Dickstein Google Brain jaschasd@google.com

conf/journal

year

2020

どんな論文か？

白色化を行うと学習速度は向上するが、汎化性能は下がるという研究(最初の層が全結合の場合)。

yusukekyokawa / paper_list

[2020]Whitening and second order optimization both destroy information about the dataset, and can make generalization impossible #52