search

djstrouse / information-bottleneck

a python implementation of various versions of the information bottleneck, including automated parameter searching
120 stars 32 forks source link

Question : What does smoothing do ? #4

Open CNelias opened 4 years ago

CNelias commented 4 years ago

Hello,

I read Tishby's article and roughly understand the algorithm and there was no mention of smoothing anywhere. Could tell me what the smoothing parameter does ? It might be usefull to include some infos about the dataset class in the readme.

Thanks !

djstrouse commented 4 years ago

Hi, great question. The need for smoothing arises when dealing with non-categorical data, for example data with geometric structure. See this paper for details: https://arxiv.org/abs/1712.09657. I'll add a link to the README to reflect that. Apologies the documentation isn't more complete / clear - I'm not actively working on this repo much anymore.