search

snorkel-team / snorkel

A system for quickly generating training data with weak supervision
https://snorkel.org
Apache License 2.0
5.81k stars 857 forks source link

Find dependent pairs of labeling functions #1512

Closed winklerjustine closed 4 years ago

winklerjustine commented 4 years ago

Hi,

How can I find all pairs (or sets of 3, ..., n) of LFs that are dependent according to what the generative model has learned? Alternatively, is there a way to find the correlations of LFs?

Thanks in advance!

paroma commented 4 years ago

We published a few papers on how to learn dependencies among LFs (ICML '17 and ICML '19) and have a prototype of the algorithm over synthetic data here.

winklerjustine commented 4 years ago

Hi @paroma, Unfortunately, when clicking on the last link to the algorithm over synthetic data, I get a 404 error. :/ Could you please tell me where I can find that algorithm? Sounds like exactly what I need. Thank you!

paroma commented 4 years ago

Sorry about that! Fixed the link above - here's the notebook