search

dataproofer / Dataproofer

A proofreader for your data
http://dataproofer.org/
691 stars 53 forks source link

Test: Suspicious Numbers #19

Open newsroomdev opened 8 years ago

newsroomdev commented 8 years ago

Please read how to create a new test if you're interested in writing this test.

related to #6, #7, #8

Suspicious numbers are present

If you see any of these numbers in your data, treat them with an abundance of caution:

Each of these numbers has an indication of a particular error made by either a human or a computer. If you see them, ensure they actually mean what you think they mean! -Quartz Guide to Bad Data

ejfox commented 8 years ago

@enjalot @geraldarthur Want to combine all of our "small integer" "big integer" etc tests into one big "Suspicious numbers" test

enjalot commented 8 years ago

my only concern is that right now I'm not sure we have a way to indicating to the user which of the problems it would be for a given cell. this may be something we want to allow via highlightCells but i'm not sure

On Wed, Apr 6, 2016 at 2:20 PM, EJ Fox notifications@github.com wrote:

@enjalot https://github.com/enjalot @geraldarthur https://github.com/geraldarthur Want to combine all of our "small integer" "big integer" etc tests into one big "Suspicious numbers" test

— You are receiving this because you were mentioned. Reply to this email directly or view it on GitHub https://github.com/dataproofer/Dataproofer/issues/19#issuecomment-206574998

Ian Johnson - 周彦 http://enja.org

newsroomdev commented 8 years ago

Note: this test can be implemented more efficiently using a Bloom or Cuckoo filter