search

scraperwiki / magic-summary-tool

ScraperWiki tool to summarise stuff about any table of data
8 stars 3 forks source link

Deal gracefully with larger datasets #10

Closed frabcus closed 10 years ago

frabcus commented 11 years ago

For example, if more than (say) 100,000 rows, should take a sample at random, and all the facts make as much sense as now.

frabcus commented 11 years ago

Example is Tweets matching 'banana': https://scraperwiki.com/dataset/bizrf5q/view/arxd2dy

frabcus commented 10 years ago

This doesn't seem to be a problem in practice, although I'm not sure why not!