keroro824 / HashingDeepLearning

Codebase for "SLIDE : In Defense of Smart Algorithms over Hardware Acceleration for Large-Scale Deep Learning Systems"
MIT License
1.07k stars 169 forks source link

active neurons during inference #31

Closed hieuhoang closed 3 years ago

hieuhoang commented 4 years ago

is it possible to tell which neurons are active during inference? I would have thought it was train._ActiveinputIds but this variable is forceable switched on at https://github.com/keroro824/HashingDeepLearning/blob/4da2a6290e0965f0d4679198a01461964a61242c/SLIDE/Node.cpp#L94 during inference.

Any advise gratefully appreciated