harvard-lil / capstone

CAP database scripts.
MIT License
187 stars 43 forks source link

Find outlier decision dates #427

Closed jcushman closed 1 year ago

jcushman commented 6 years ago

We should be able to do a report of likely-incorrect decision dates based on variance. Like if a volume has a bunch of dates between 1658 and 1800, that's fine, but if it has all dates in 1940 and one date in 1640, that's an error. Could maybe calculate the standard deviation for each volume and report dates > a given number of standard deviations from the mean.

mlissner commented 5 years ago

Familiar. FWIW, we have code to catch transposed digits in years when we scrape, which automatically corrects errors like:

2109

Instead of:

2019

That accounts for a fair number of these we've seen in the wild. Happy to share if useful.

mlissner commented 4 years ago

OK, I know I'm replying to myself, but we actually have an issue for this too. I wonder if we talked about this. Ours is here: https://github.com/freelawproject/courtlistener/issues/592, so I'm mostly just connecting things. If one of us tackles this, I suspect there will be useful things for the other.

ChefAndy commented 4 years ago

missing_jurisdiction_updated.xlsx

Here's my first pass at identifying outlier years. I ended up looking at the standard deviation of the interval between years to find ones with very different intervals, and then calculated the z-score of each year to get the outliers. I'm not a statistics guy, but it looks like a good first pass.

mlissner commented 4 years ago

Wow, that's a remarkably and wonderfully short list. Do you have code of your stats work somewhere, @ChefAndy

ChefAndy commented 4 years ago

Ha, misdrag-and-drop. Sorry about that!

427_decision_outliers.xlsx

ChefAndy commented 4 years ago

At @jcushman's suggestion, I ran a report that checked to see if the decision date was outside of other date ranges we had for that book. I took the spine start/end years, page start/end years, and the other start/end year values for each volume, found the extreme values among them that were between 1600 and 2020, and looked for cases with decision dates outside of those ranges. It looks like there are a lot of volumes (16,807) that have cases outside of those dates, and all of the ones in the sample I took seemed to not be mistakes. 210 books didn't seem to have good values at all for the start/end years.


32044057890105 start: 1875 end: 1876:

Screen Shot 2020-04-01 at 8 15 36 AM

32044078531571 start: 1996 end: 1996:

Screen Shot 2020-04-01 at 8 16 00 AM

32044078566718 start: 1945 end: 1945:

Screen Shot 2020-04-01 at 8 18 48 AM

I'm going to make a subsequent report that uses this as an initial filter to see if I can narrow down my purely statistical report.

mlissner commented 4 years ago

FWIW, we're working on adding per-volume date information to the reporter DB at some point sorta soon, I think: https://github.com/freelawproject/reporters-db/issues/19

The underlying goal is to be able to look up reporter citations that lack page numbers, like, 444 U.S. ____

ChefAndy commented 4 years ago

Thanks @mlissner. Just subscribed to that thread.

ChefAndy commented 4 years ago

Going to do one pass with only volumes that have cases with decision dates greater than the publication date, then for the rest, do the statistical analysis in the other report, maybe with the spine/etc. dates as a selection criteria.

ChefAndy commented 4 years ago

Here's a list of cases/volumes in which the decision date is greater than the publication year value.

https://docs.google.com/spreadsheets/d/1BkJIO8gcU7esFge052CIZWeeTNe-Yd-O2ugy63va8yc/edit?usp=sharing

ChefAndy commented 4 years ago

New spreadsheet for the statistical method: https://docs.google.com/spreadsheets/d/1cnoJaEMYSNNFhjhMzchRlLecrrkraG2X-NtgYuXtoqY/edit?usp=sharing

jcushman commented 4 years ago

I did a little processing of the statistical spreadsheet to find rows where the likely-wrong date was one Damerau–Levenshtein edit away from a statistically likely date, and see if it would make sense to update those dates automatically.

https://github.com/harvard-lil/capstone/pull/1532

From the output, it's hard for me to tell if these are actual errors, even the ones with high deviation. Often they seem to either be cases the reporter intentionally included from a decade or two previously, or cases where the reporter typo'd a date a decade or two earlier but it's hard to find conclusive evidence of that in the text.

Output -- rows are [deviations, wrong_date, corrected_date, url]

 [inf, '2000', '2010', 'https://cite.case.law/or-app/239/101/'],
 [inf, '1988', '1998', 'https://cite.case.law/tca/4/13/'],
 [inf, '1982', '1992', 'https://cite.case.law/pr-dec/131/1/'],
 [inf, '1982', '1992', 'https://cite.case.law/ark-app/37/18/'],
 [inf, '1980', '1990', 'https://cite.case.law/cal-app-3d/219/1390/'],
 [inf, '1980', '1990', 'https://cite.case.law/cal-app-3d/218/828/'],
 [inf, '1977', '1997', 'https://cite.case.law/cal-app-4th/59/1289/'],
 [inf, '1963', '1973', 'https://cite.case.law/ind-app/156/265/'],
 [inf, '1958', '1968', 'https://cite.case.law/ga-app/118/100/'],
 [inf, '1958', '1968', 'https://cite.case.law/ark/244/142/'],
 [inf, '1957', '1967', 'https://cite.case.law/colo/163/121/'],
 [inf, '1952', '1992', 'https://cite.case.law/mass-app-ct/32/501/'],
 [inf, '1952', '1962', 'https://cite.case.law/pa-super/199/489/'],
 [inf, '1950', '1960', 'https://cite.case.law/nc/252/485/'],
 [inf, '1948', '1958', 'https://cite.case.law/kan/183/224/'],
 [inf, '1939', '1959', 'https://cite.case.law/p2d/343/1069/'],
 [inf, '1936', '1966', 'https://cite.case.law/cal-2d/64/529/'],
 [inf, '1933', '1993', 'https://cite.case.law/cal-app-4th/17/1/'],
 [inf, '1933', '1943', 'https://cite.case.law/tex/141/565/'],
 [inf, '1932', '1952', 'https://cite.case.law/ill/412/383/'],
 [inf, '1931', '1941', 'https://cite.case.law/sw2d/152/774/'],
 [inf, '1928', '1938', 'https://cite.case.law/wis/227/519/'],
 [inf, '1928', '1938', 'https://cite.case.law/wis/227/506/'],
 [inf, '1928', '1938', 'https://cite.case.law/wis/227/407/'],
 [inf, '1925', '1975', 'https://cite.case.law/colo/189/429/'],
 [inf, '1924', '1934', 'https://cite.case.law/sc/172/329/'],
 [inf, '1921', '1931', 'https://cite.case.law/mont/90/344/'],
 [inf, '1920', '1930', 'https://cite.case.law/sc/156/232/'],
 [inf, '1920', '1930', 'https://cite.case.law/bta/20/206/'],
 [inf, '1918', '1928', 'https://cite.case.law/wis/195/361/'],
 [inf, '1918', '1928', 'https://cite.case.law/ga/166/323/'],
 [inf, '1918', '1928', 'https://cite.case.law/ga/166/293/'],
 [inf, '1917', '1947', 'https://cite.case.law/cal-app-2d/82/592/'],
 [inf, '1914', '1941', 'https://cite.case.law/ga/192/118/'],
 [inf, '1914', '1924', 'https://cite.case.law/minn/159/290/'],
 [inf, '1913', '1923', 'https://cite.case.law/pa-super/81/140/'],
 [inf, '1912', '1942', 'https://cite.case.law/ark/204/1112/'],
 [inf, '1910', '1920', 'https://cite.case.law/ny/228/605/'],
 [inf, '1907', '1967', 'https://cite.case.law/ariz/102/595/'],
 [inf, '1907', '1967', 'https://cite.case.law/ariz/102/335/'],
 [inf, '1904', '1914', 'https://cite.case.law/pa-super/57/37/'],
 [inf, '1904', '1914', 'https://cite.case.law/mass/218/281/'],
 [inf, '1902', '1912', 'https://cite.case.law/ark/103/505/'],
 [inf, '1901', '1921', 'https://cite.case.law/kan/109/20/'],
 [inf, '1901', '1911', 'https://cite.case.law/kan/85/875/'],
 [inf, '1900', '1910', 'https://cite.case.law/sc/85/196/'],
 [inf, '1889', '1899', 'https://cite.case.law/tex-civ-app/21/613/'],
 [inf, '1889', '1899', 'https://cite.case.law/mo/152/560/'],
 [inf, '1889', '1899', 'https://cite.case.law/mo/148/665/'],
 [inf, '1889', '1899', 'https://cite.case.law/ill-app/81/605/'],
 [inf, '1889', '1899', 'https://cite.case.law/cal/124/422/'],
 [inf, '1889', '1899', 'https://cite.case.law/cal/124/42/'],
 [inf, '1889', '1899', 'https://cite.case.law/cal/124/406/'],
 [inf, '1888', '1988', 'https://cite.case.law/mich-app/173/188/'],
 [inf, '1886', '1896', 'https://cite.case.law/pa/173/28/'],
 [inf, '1886', '1896', 'https://cite.case.law/ny/150/566/2273965/'],
 [inf, '1886', '1896', 'https://cite.case.law/cal/111/25/'],
 [inf, '1885', '1895', 'https://cite.case.law/neb/44/73/'],
 [inf, '1885', '1895', 'https://cite.case.law/mo/130/621/'],
 [inf, '1885', '1895', 'https://cite.case.law/mo-app/63/492/'],
 [inf, '1884', '1894', 'https://cite.case.law/ohio-st-ns/51/575/932825/'],
 [inf, '1884', '1894', 'https://cite.case.law/mo-app/59/221/'],
 [inf, '1883', '1893', 'https://cite.case.law/misc/4/426/'],
 [inf, '1883', '1893', 'https://cite.case.law/misc/3/408/'],
 [inf, '1883', '1893', 'https://cite.case.law/minn/53/504/'],
 [inf, '1880', '1890', 'https://cite.case.law/wis/77/505/'],
 [inf, '1880', '1890', 'https://cite.case.law/ny/120/664/2231683/'],
 [inf, '1877', '1887', 'https://cite.case.law/us/120/73/'],
 [inf, '1876', '1896', 'https://cite.case.law/pa/173/15/'],
 [inf, '1869', '1896', 'https://cite.case.law/ad/8/619/2285964/'],
 [inf, '1866', '1876', 'https://cite.case.law/w-va/9/600/'],
 [inf, '1865', '1895', 'https://cite.case.law/pa/169/598/'],
 [inf, '1865', '1895', 'https://cite.case.law/ohio-st-ns/53/646/935869/'],
 [inf, '1864', '1964', 'https://cite.case.law/kan/193/97/'],
 [inf, '1864', '1874', 'https://cite.case.law/mass/115/578/'],
 [inf, '1862', '1872', 'https://cite.case.law/tex/35/797/'],
 [inf, '1861', '1891', 'https://cite.case.law/minn/47/527/'],
 [inf, '1855', '1885', 'https://cite.case.law/ill-app/17/663/867475/'],
 [inf, '1837', '1937', 'https://cite.case.law/cal-app-2d/21/540/'],
 [inf, '1834', '1884', 'https://cite.case.law/us/110/398/'],
 [inf, '1833', '1893', 'https://cite.case.law/ny-st-rptr/55/62/'],
 [inf, '1833', '1883', 'https://cite.case.law/ny/91/657/2188477/'],
 [inf, '1815', '1915', 'https://cite.case.law/ky/164/385/'],
 [inf, '1811', '1911', 'https://cite.case.law/misc/72/289/'],
 [inf, '1808', '1908', 'https://cite.case.law/misc/58/310/'],
 [inf, '1806', '1906', 'https://cite.case.law/ny/185/551/47756/'],
 [inf, '1800', '1890', 'https://cite.case.law/ny/123/463/'],
 [inf, '1714', '1914', 'https://cite.case.law/ad/161/883/2737575/'],
 [1599.94955752179, '1828', '1928', 'https://cite.case.law/fla/95/391/'],
 [1033.9636989610556, '1803', '1893', 'https://cite.case.law/cal/98/227/'],
 [1025.0417159008778, '1640', '1940', 'https://cite.case.law/f-supp/32/817/'],
 [738.7460150534026, '1825', '1925', 'https://cite.case.law/fla/91/272/'],
 [729.1291721956454, '1771', '1971', 'https://cite.case.law/ill-app-3d/2/538/'],
 [613.7805095623593, '1955', '1995', 'https://cite.case.law/wash-app/77/596/'],
 [611.8121668052878, '1901', '1961', 'https://cite.case.law/pr-dec/83/434/'],
 [576.557306990619, '1839', '1889', 'https://cite.case.law/cal/79/211/'],
 [559.4342257015245, '1641', '1941', 'https://cite.case.law/f-supp/42/135/'],
 [540.9460392602055,
  '1830',
  '1880',
  'https://cite.case.law/jones-and-spencers-super-ct-rep/14/577/1666618/'],
 [432.6511095255927, '1809', '1899', 'https://cite.case.law/f/108/469/'],
 [369.84508983221014, '1878', '1978', 'https://cite.case.law/misc-2d/96/393/'],
 [357.16827792981053,
  '1808',
  '1898',
  'https://cite.case.law/ga/105/499/391619/'],
 [349.9301146034497, '1933', '1983', 'https://cite.case.law/pa-commw/71/172/'],
 [311.16047063849965, '1804', '1894', 'https://cite.case.law/cal/102/537/'],
 [307.7682265114448, '1914', '1941', 'https://cite.case.law/fla/147/549/'],
 [253.04112746313047, '1828', '1928', 'https://cite.case.law/me/127/218/'],
 [248.54933481304474, '1819', '1919', 'https://cite.case.law/ny/227/184/'],
 [227.78415255464725, '1858', '1958', 'https://cite.case.law/kan/182/540/'],
 [226.216693024032, '1817', '1917', 'https://cite.case.law/ariz/18/503/'],
 [210.62600012013127, '1930', '1950', 'https://cite.case.law/so-2d/47/336/'],
 [208.70136095511245, '1868', '1898', 'https://cite.case.law/f/95/1000/'],
 [205.56918273148082, '1902', '1932', 'https://cite.case.law/nd/62/771/'],
 [205.56918273148082, '1902', '1932', 'https://cite.case.law/nd/62/767/'],
 [205.1751127250095,
  '1932',
  '1952',
  'https://cite.case.law/f2d/196/500/499344/'],
 [204.94064181285944, '1810', '1910', 'https://cite.case.law/ny-crim/25/173/'],
 [203.08709052185867, '1866', '1886', 'https://cite.case.law/mich/61/237/'],
 [200.45000000000084, '1903', '1913', 'https://cite.case.law/pr-dec/19/365/'],
 [197.22334142163575, '1822', '1882', 'https://cite.case.law/va/76/671/'],
 [194.09615605830578, '1807', '1897', 'https://cite.case.law/nd/7/109/'],
 [183.7657157791824, '1832', '1892', 'https://cite.case.law/nys/18/156/'],
 [175.711400095605, '1842', '1942', 'https://cite.case.law/frd/2/514/'],
 [164.90836822764487, '1930', '1960', 'https://cite.case.law/f2d/275/431/'],
 [159.62556235798266, '1963', '1973', 'https://cite.case.law/f2d/483/1392/'],
 [158.31421494389795, '1642', '1942', 'https://cite.case.law/f-supp/43/416/'],
 [144.10836200581846, '1936', '1956', 'https://cite.case.law/f-supp/145/756/'],
 [137.26162871312982,
  '1887',
  '1837',
  'https://cite.case.law/va/35/565/6718311/'],
 [136.37819909156045, '1718', '1818', 'https://cite.case.law/ky/8/393/'],
 [135.14014966586768, '1931', '1961', 'https://cite.case.law/f2d/288/683/'],
 [131.64525173057552, '2007', '2017', 'https://cite.case.law/f-appx/676/650/'],
 [126.801593317263,
  '1910',
  '1940',
  'https://cite.case.law/us/311/629/6148373/'],
 [120.40758455426905, '1945', '1965', 'https://cite.case.law/misc-2d/51/955/'],
 [119.08223449124712, '1886', '1896', 'https://cite.case.law/iowa/97/570/'],
 [113.05150532895549, '1875', '1885', 'https://cite.case.law/me/77/182/'],
 [105.86038353192727, '1836', '1886', 'https://cite.case.law/ga/78/89/'],
 [100.69417660321407,
  '1846',
  '1946',
  'https://cite.case.law/ohio-law-abs/46/198/'],
 [100.11111111111119, '1937', '1947', 'https://cite.case.law/tenn/186/459/'],
 [89.57812336032435, '1833', '1883', 'https://cite.case.law/conn/51/107/'],
 [88.38117971242372, '1879', '1899', 'https://cite.case.law/f/115/528/'],
 [86.12655692243149, '1913', '1943', 'https://cite.case.law/f-supp/50/221/'],
 [86.12655692243149, '1913', '1943', 'https://cite.case.law/f-supp/50/119/'],
 [83.48163537683081,
  '1855',
  '1885',
  'https://cite.case.law/how-pr/2/38/2290660/'],
 [80.58229473070615, '1913', '1953', 'https://cite.case.law/tex-crim/159/130/'],
 [80.36905724541667, '1917', '1947', 'https://cite.case.law/nc/227/716/'],
 [79.35741931287849,
  '1882',
  '1822',
  'https://cite.case.law/va/22/121/4443365/'],
 [76.90300935387457, '1912', '1952', 'https://cite.case.law/nd/78/1/'],
 [72.47762991162733, '1812', '1842', 'https://cite.case.law/va/40/268/'],
 [71.63544069548489, '1927', '1937', 'https://cite.case.law/miss/178/776/'],
 [70.60447722164773, '1910', '1940', 'https://cite.case.law/pr-dec/55/864/'],
 [69.4350958603334, '1819', '1879', 'https://cite.case.law/how-pr/58/167/'],
 [68.92973760113789,
  '1914',
  '1934',
  'https://cite.case.law/ohio-law-abs/15/113/'],
 [67.17148204409354, '1986', '1996', 'https://cite.case.law/br/189/769/'],
 [65.09276440998012,
  '1924',
  '1934',
  'https://cite.case.law/ohio-law-abs/20/448/'],
 [65.09276440998012,
  '1924',
  '1934',
  'https://cite.case.law/ohio-law-abs/20/432/1665958/'],
 [64.925662089779, '1885', '1895', 'https://cite.case.law/ind-app/13/446/'],
 [64.76825647185156, '1839', '1889', 'https://cite.case.law/ny/117/118/'],
 [64.24023579297378, '1911', '1941', 'https://cite.case.law/pr/59/274/'],
 [63.22106631342454,
  '1934',
  '1954',
  'https://cite.case.law/mass-app-dec/8/66/'],
 [63.22106631342454,
  '1934',
  '1954',
  'https://cite.case.law/mass-app-dec/8/62/'],
 [62.93250352560289, '1869', '1899', 'https://cite.case.law/us/172/557/'],
 [61.78086356126073, '1919', '1949', 'https://cite.case.law/wis/254/273/'],
 [60.99192537471873,
  '1966',
  '1996',
  'https://cite.case.law/wash-app/84/1015/121866/'],
 [60.95412386134485, '1883', '1833', 'https://cite.case.law/wright/1/371/'],
 [60.95412386134485, '1883', '1833', 'https://cite.case.law/wright/1/366/'],
 [60.95412386134485, '1883', '1833', 'https://cite.case.law/wright/1/365/'],
 [60.95412386134485, '1883', '1833', 'https://cite.case.law/wright/1/364/'],
 [60.95412386134485, '1883', '1833', 'https://cite.case.law/wright/1/360/'],
 [60.95412386134485, '1883', '1833', 'https://cite.case.law/wright/1/359/'],
 [60.95412386134485, '1883', '1833', 'https://cite.case.law/wright/1/358/'],
 [60.95412386134485,
  '1883',
  '1833',
  'https://cite.case.law/wright/1/356/626153/'],
 [60.95412386134485,
  '1883',
  '1833',
  'https://cite.case.law/wright/1/356/625794/'],
 [60.95412386134485, '1883', '1833', 'https://cite.case.law/wright/1/355/'],
 [60.95412386134485,
  '1883',
  '1833',
  'https://cite.case.law/wright/1/354/625994/'],
 [60.95412386134485,
  '1883',
  '1833',
  'https://cite.case.law/wright/1/354/625970/'],
 [60.95412386134485, '1883', '1833', 'https://cite.case.law/wright/1/353/'],
 [60.95412386134485, '1883', '1833', 'https://cite.case.law/wright/1/351/'],
 [60.95412386134485, '1883', '1833', 'https://cite.case.law/wright/1/350/'],
 [60.26896237771887, '1886', '1896', 'https://cite.case.law/tenn/96/249/'],
 [60.229940094343156, '1942', '1962', 'https://cite.case.law/misc-2d/34/496/'],
 [60.09635120846707, '2003', '2013', 'https://cite.case.law/sw3d/446/386/'],
 [59.95497451947758,
  '1957',
  '1975',
  'https://cite.case.law/sw2d/526/547/10129767/'],
 [59.05496009386771, '1923', '1953', 'https://cite.case.law/nd/79/591/'],
 [57.46821864166434, '1924', '1934', 'https://cite.case.law/fla/116/3/'],
 [54.98047028423875,
  '1941',
  '1951',
  'https://cite.case.law/f-supp/113/437/4232729/'],
 [54.451248484662614, '1929', '1939', 'https://cite.case.law/fla/140/176/'],
 [53.460527844225574, '1882', '1892', 'https://cite.case.law/ct-cl/27/221/'],
 [52.92785383058246, '1914', '1954', 'https://cite.case.law/misc-2d/15/831/'],
 [52.88418328862834, '1912', '1932', 'https://cite.case.law/nj-eq/112/308/'],
 [52.63671797535899, '1842', '1942', 'https://cite.case.law/f-supp/43/647/'],
 [51.95414400200691, '1873', '1893', 'https://cite.case.law/f/75/420/'],
 [51.59086935734964, '1931', '1941', 'https://cite.case.law/f-supp/47/710/'],
 [50.15025019292376, '1943', '1963', 'https://cite.case.law/misc-2d/53/786/'],
 [48.277294726361944, '1910', '1950', 'https://cite.case.law/misc-2d/9/209/'],
 [46.804422724886216, '1905', '1915', 'https://cite.case.law/f/232/613/'],
 [45.80786674510953, '1977', '1997', 'https://cite.case.law/vt/166/630/'],
 [45.199465642330146, '1879', '1897', 'https://cite.case.law/f/81/374/'],
 [45.145055192393436, '1876', '1896', 'https://cite.case.law/f/75/124/'],
 [45.11523706448452, '1909', '1919', 'https://cite.case.law/okla/78/44/'],
 [44.90144319163613, '1910', '1940', 'https://cite.case.law/f-supp/31/892/'],
 [43.41075236681166, '1854', '1864', 'https://cite.case.law/pa/47/367/'],
 [43.00494595923414, '1802', '1882', 'https://cite.case.law/f/89/582/'],
 [42.89524657405761, '1857', '1867', 'https://cite.case.law/pa/55/62/'],
 [41.85495047700621,
  '1876',
  '1886',
  'https://cite.case.law/ct-cl/21/126/3491807/'],
 [41.775413374692256, '1913', '1923', 'https://cite.case.law/f2d/1/323/'],
 [41.70348100421417, '1977', '1997', 'https://cite.case.law/vt/167/564/'],
 [41.60996194951719, '1928', '1948', 'https://cite.case.law/so-2d/38/397/'],
 [41.264977897513205,
  '1866',
  '1886',
  'https://cite.case.law/ny-st-rptr/5/144/'],
 [40.76734220520379,
  '1837',
  '1867',
  'https://cite.case.law/robertsons-super-ct-rep/4/449/'],
 [40.6678819814543,
  '2001',
  '2011',
  'https://cite.case.law/so-3d/110/574/7006169/'],
 [40.638855854539976, '1925', '1935', 'https://cite.case.law/okla-crim/62/30/'],
 [40.35682064128212, '1866', '1886', 'https://cite.case.law/va/82/567/'],
 [40.35382179982658, '1983', '1993', 'https://cite.case.law/sw2d/878/6/'],
 [39.71144521087414,
  '1886',
  '1896',
  'https://cite.case.law/ny-st-rptr/73/784/'],
 [39.083376074378585, '1977', '1997', 'https://cite.case.law/ga/267/515/'],
 [38.87555936359987,
  '1928',
  '1948',
  'https://cite.case.law/ohio-law-abs/57/374/'],
 [38.7362762334613, '1921', '1931', 'https://cite.case.law/f2d/58/981/'],
 [38.29107821199708, '1866', '1886', 'https://cite.case.law/va/81/473/'],
 [38.28193037490033, '1950', '1960', 'https://cite.case.law/ark/232/602/'],
 [38.05205898825713, '1882', '1892', 'https://cite.case.law/iowa/85/606/'],
 [38.05205898825713, '1882', '1892', 'https://cite.case.law/iowa/85/121/'],
 [37.771257790892975,
  '2002',
  '2012',
  'https://cite.case.law/f-supp-2d/925/1051/'],
 [37.30704444825586, '1929', '1949', 'https://cite.case.law/f-supp/82/910/'],
 [36.753279737032386,
  '1825',
  '1835',
  'https://cite.case.law/va/33/236/6717626/'],
 [35.571428571428704, '1991', '1981', 'https://cite.case.law/mont/194/173/'],
 [35.10128202786873, '1958', '1968', 'https://cite.case.law/colo/167/19/'],
 [34.87544620456475, '1951', '1961', 'https://cite.case.law/tex-crim/171/541/'],
 [34.49965392140595, '1901', '1921', 'https://cite.case.law/sw/236/763/'],
 [34.035171289108156, '1975', '1985', 'https://cite.case.law/br/75/707/'],
 [33.742055595198686, '2003', '2013', 'https://cite.case.law/frd/290/89/'],
 [33.57220108962965, '1907', '1917', 'https://cite.case.law/ind/186/88/'],
 [33.432123721829484, '1930', '1950', 'https://cite.case.law/f-supp/94/259/'],
 [33.078857784290875, '1908', '1918', 'https://cite.case.law/neb/102/654/'],
 [32.38067127185992, '1824', '1834', 'https://cite.case.law/wend/12/261/'],
 [32.258397323813874, '1832', '1852', 'https://cite.case.law/scl/40/521/'],
 [32.258397323813874, '1832', '1852', 'https://cite.case.law/scl/40/517/'],
 [32.258397323813874, '1832', '1852', 'https://cite.case.law/scl/40/515/'],
 [32.258397323813874, '1832', '1852', 'https://cite.case.law/scl/40/513/'],
 [32.258397323813874, '1832', '1852', 'https://cite.case.law/scl/40/511/'],
 [32.132029384224836,
  '1883',
  '1893',
  'https://cite.case.law/ct-cl/28/553/5648322/'],
 [31.62410346700247, '1954', '1964', 'https://cite.case.law/misc-2d/44/432/'],
 [30.98000595917896,
  '1871',
  '1881',
  'https://cite.case.law/jones-and-spencers-super-ct-rep/15/85/'],
 [30.30169726505179, '2003', '2013', 'https://cite.case.law/va-cir/88/423/'],
 [30.180682662059706,
  '2004',
  '2014',
  'https://cite.case.law/f-supp-3d/61/740/'],
 [29.85919336772895, '1957', '1967', 'https://cite.case.law/frd/42/390/'],
 [29.591130491072846, '1946', '1956', 'https://cite.case.law/f-supp/152/139/'],
 [29.591130491072846, '1946', '1956', 'https://cite.case.law/f-supp/152/136/'],
 [29.552789226174337, '1887', '1897', 'https://cite.case.law/ill-app/69/472/'],
 [29.552789226174337, '1887', '1897', 'https://cite.case.law/ill-app/69/441/'],
 [29.240940542168055, '1855', '1885', 'https://cite.case.law/ri/15/27/'],
 [29.197827595370576, '1886', '1896', 'https://cite.case.law/ind-app/15/639/'],
 [28.920015535580024, '1914', '1924', 'https://cite.case.law/f2d/9/183/'],
 [28.741319123295856, '1844', '1854', 'https://cite.case.law/tenn/33/629/'],
 [27.80176752496084, '1914', '1924', 'https://cite.case.law/okla/98/285/'],
 [27.43958486584799, '1907', '1917', 'https://cite.case.law/f/240/167/'],
 [27.28002932549764,
  '1837',
  '1827',
  'https://cite.case.law/va/26/453/6732940/'],
 [27.06188647953732, '1982', '1992', 'https://cite.case.law/va-cir/31/480/'],
 [26.915030012610224, '1880', '1890', 'https://cite.case.law/daly-ny/16/528/'],
 [26.38560213449732, '1817', '1827', 'https://cite.case.law/va/26/517/'],
 [26.345358163948834, '1885', '1895', 'https://cite.case.law/f/72/60/'],
 [25.96983218867709, '1905', '1915', 'https://cite.case.law/f/221/512/'],
 [25.573160372286225, '1883', '1893', 'https://cite.case.law/f/88/983/'],
 [25.573160372286225, '1883', '1893', 'https://cite.case.law/f/88/649/'],
 [25.483826708891716, '1909', '1919', 'https://cite.case.law/nd/44/367/'],
 [25.45584412271555, '1886', '1896', 'https://cite.case.law/ill-app/63/218/'],
 [25.310435170342373, '1913', '1923', 'https://cite.case.law/sw/248/816/'],
 [25.039994889896203, '1934', '1944', 'https://cite.case.law/ccpa/32/1228/'],
 [24.922849287390054, '1903', '1913', 'https://cite.case.law/f/225/511/'],
 [24.816915810487654,
  '1926',
  '1936',
  'https://cite.case.law/pr-dec/50/989/8807701/'],
 [24.777050354748596, '1869', '1879', 'https://cite.case.law/me/70/248/'],
 [24.67110097868956, '2000', '2010', 'https://cite.case.law/so-3d/127/225/'],
 [24.59859567314596, '1879', '1897', 'https://cite.case.law/ri/20/700/'],
 [24.175685473548334,
  '1882',
  '1892',
  'https://cite.case.law/jones-and-spencers-super-ct-rep/28/247/'],
 [23.991460593930057, '1938', '1948', 'https://cite.case.law/f-supp/83/914/'],
 [23.930207726180594, '1936', '1956', 'https://cite.case.law/misc-2d/14/203/'],
 [23.92110319534172,
  '1937',
  '1947',
  'https://cite.case.law/ohio-law-abs/55/398/'],
 [23.826028340359272, '1937', '1947', 'https://cite.case.law/f-supp/81/355/'],
 [23.697637799541074,
  '1851',
  '1861',
  'https://cite.case.law/luz-lo/1/356/11914315/'],
 [23.697637799541074,
  '1851',
  '1861',
  'https://cite.case.law/luz-lo/1/356/11914285/'],
 [23.697637799541074,
  '1851',
  '1861',
  'https://cite.case.law/luz-lo/1/356/11914265/'],
 [23.564130062121897, '1917', '1927', 'https://cite.case.law/misc/135/622/'],
 [23.498609634007334, '1861', '1881', 'https://cite.case.law/miss-dec/2/88/'],
 [23.410229280198358, '2005', '2015', 'https://cite.case.law/br/581/244/'],
 [23.166165021730475, '1862', '1852', 'https://cite.case.law/ny/6/144/'],
 [22.953170016730017, '1924', '1934', 'https://cite.case.law/okla/167/433/'],
 [22.823496347043385, '1904', '1914', 'https://cite.case.law/f/225/426/'],
 [22.80851077981376, '1877', '1887', 'https://cite.case.law/us/119/615/'],
 [22.65078257991276, '1964', '1974', 'https://cite.case.law/ark/255/1057/'],
 [22.64285714285701,
  '1815',
  '1825',
  'https://cite.case.law/va/24/191/6714889/'],
 [22.642452876596987,
  '1834',
  '1824',
  'https://cite.case.law/va/23/483/6715237/'],
 [22.627416997969682,
  '1963',
  '1973',
  'https://cite.case.law/ohio-app-2d/40/16/'],
 [22.621574485077474,
  '1826',
  '1836',
  'https://cite.case.law/whart/1/532/1831887/'],
 [22.621574485077474,
  '1826',
  '1836',
  'https://cite.case.law/whart/1/532/1829036/'],
 [22.537188933584915, '1935', '1945', 'https://cite.case.law/tenn/184/428/'],
 [22.535572433868307, '1943', '1953', 'https://cite.case.law/tenn-app/39/190/'],
 [22.44809249368186, '1886', '1896', 'https://cite.case.law/f/75/661/'],
 [22.387746802582786,
  '1927',
  '1937',
  'https://cite.case.law/pr-dec/50/981/8807192/'],
 [22.337037545543264, '1901', '1801', 'https://cite.case.law/va/7/25/'],
 [22.266358633980506, '1848', '1858', 'https://cite.case.law/ky/58/365/'],
 [22.219721754327164, '1931', '1941', 'https://cite.case.law/misc/179/1061/'],
 [22.166666666666874, '1929', '1939', 'https://cite.case.law/wis/233/54/'],
 [22.06175578346525, '1924', '1934', 'https://cite.case.law/kan/138/797/'],
 [21.920310216782813, '1887', '1897', 'https://cite.case.law/mich/115/340/'],
 [21.915253967989692, '1888', '1898', 'https://cite.case.law/or/33/578/'],
 [21.790407560591916, '1867', '1897', 'https://cite.case.law/nm/9/645/'],
 [21.582041418376303,
  '1879',
  '1897',
  'https://cite.case.law/ohio-cir-dec/7/411/'],
 [21.521658732155586,
  '1927',
  '1937',
  'https://cite.case.law/ala/235/696/5784293/'],
 [21.503488089145122, '1885', '1895', 'https://cite.case.law/mont/15/219/'],
 [21.497590608835786, '1924', '1934', 'https://cite.case.law/ohio-app/51/174/'],
 [21.497590608835786, '1924', '1934', 'https://cite.case.law/ohio-app/51/169/'],
 [21.38495264537003, '1936', '1946', 'https://cite.case.law/f-supp/75/683/'],
 [21.361959960016154,
  '1819',
  '1829',
  'https://cite.case.law/hall-super-ct-rep/1/655/'],
 [21.336260296624427,
  '1903',
  '1913',
  'https://cite.case.law/mont/48/619/2330847/'],
 [21.197613628175546, '1968', '1978', 'https://cite.case.law/f2d/589/957/'],
 [21.02036592275711, '1882', '1892', 'https://cite.case.law/va/89/507/'],
 [20.976613525979587, '1910', '1920', 'https://cite.case.law/njl/95/85/'],
 [20.940398336624668, '1938', '1958', 'https://cite.case.law/misc-2d/10/33/'],
 [20.882208321091948, '2004', '2014', 'https://cite.case.law/va-cir/89/446/'],
 [20.7414451562518, '1942', '1952', 'https://cite.case.law/ct-cl/121/891/'],
 [20.73956318261983, '1924', '1934', 'https://cite.case.law/sd/62/317/'],
 [20.629587959791948, '1939', '1959', 'https://cite.case.law/misc-2d/14/759/'],
 [20.38415644543814, '1955', '1965', 'https://cite.case.law/tenn/217/8/'],
 [20.31551231723678, '1807', '1867', 'https://cite.case.law/abb-ct-app/3/139/'],
 [20.295399129025483, '1846', '1856', 'https://cite.case.law/sc-eq/29/291/'],
 [20.249926513682233, '1874', '1884', 'https://cite.case.law/sc/20/503/'],
 [20.13625034213795, '1938', '1948', 'https://cite.case.law/f-supp/94/698/'],
 [20.108454164262294, '1943', '1953', 'https://cite.case.law/f-supp/118/272/'],
 [20.025360089171127, '1924', '1942', 'https://cite.case.law/f-supp/80/394/'],
 [19.93324981433143, '1915', '1925', 'https://cite.case.law/or/113/441/'],
 [19.874871035749067,
  '1988',
  '1998',
  'https://cite.case.law/f-supp-2d/34/550/'],
 [19.61038016738274, '1903', '1913', 'https://cite.case.law/sd/30/38/'],
 [19.271318609016866, '1885', '1895', 'https://cite.case.law/ind/143/488/'],
 [19.238869499449724, '1947', '1957', 'https://cite.case.law/me/152/464/'],
 [19.047088052388112,
  '1877',
  '1887',
  'https://cite.case.law/ny-st-rptr/5/585/'],
 [18.973910415036887, '1855', '1865', 'https://cite.case.law/pa/48/524/'],
 [18.95975079633342,
  '1841',
  '1851',
  'https://cite.case.law/sandford-super-ct-rep/5/256/'],
 [18.84250945216347, '1866', '1886', 'https://cite.case.law/ri/15/412/'],
 [18.84250945216347, '1866', '1886', 'https://cite.case.law/ri/15/302/'],
 [18.84250945216347, '1866', '1886', 'https://cite.case.law/ri/15/209/'],
 [18.784637218212314,
  '1854',
  '1864',
  'https://cite.case.law/robertsons-super-ct-rep/3/614/'],
 [18.730051116182516,
  '1935',
  '1945',
  'https://cite.case.law/f-supp/63/892/631473/'],
 [18.508580917173596,
  '1963',
  '1973',
  'https://cite.case.law/ohio-app-2d/33/121/'],
 [18.474266169676504,
  '1939',
  '1949',
  'https://cite.case.law/f-supp/94/245/1416366/'],
 [18.24138179749438, '1943', '1953', 'https://cite.case.law/misc/202/642/'],
 [18.212302416197467, '1909', '1919', 'https://cite.case.law/f/262/228/'],
 [17.931844207515535, '1953', '1963', 'https://cite.case.law/del/55/1/'],
 [17.871201816579998, '2008', '2018', 'https://cite.case.law/br/581/519/'],
 [17.774255525889327, '1944', '1954', 'https://cite.case.law/pa-d-c/88/292/'],
 [17.331137205379328, '1786', '1796', 'https://cite.case.law/va/6/412/'],
 [17.3289681934033, '1942', '1952', 'https://cite.case.law/misc-2d/14/128/'],
 [17.288850744230032, '1963', '1973', 'https://cite.case.law/pa-d-c2d/61/654/'],
 [17.12778741651188, '1943', '1953', 'https://cite.case.law/misc-2d/30/584/'],
 [16.900712467297062, '1864', '1874', 'https://cite.case.law/how-pr/48/257/'],
 [16.275146745002385,
  '1816',
  '1826',
  'https://cite.case.law/serg-rawle/12/435/'],
 [16.104719524109267, '2003', '2013', 'https://cite.case.law/sw3d/442/351/'],
 [15.726010170793645, '1882', '1842', 'https://cite.case.law/hay-haz/1/109/'],
 [15.553684912312594, '1852', '1862', 'https://cite.case.law/how-pr/32/341/'],
 [15.377340144773246, '1852', '1842', 'https://cite.case.law/hill-den/1/29/'],
 [15.128555015810864, '1944', '1954', 'https://cite.case.law/misc-2d/14/266/'],
 [14.9443855258549, '1941', '1951', 'https://cite.case.law/misc-2d/16/822/'],
 [14.9443855258549, '1941', '1951', 'https://cite.case.law/misc-2d/16/768/'],
 [14.9443855258549, '1941', '1951', 'https://cite.case.law/misc-2d/16/2/'],
 [14.773077811229633, '1853', '1863', 'https://cite.case.law/ct-cl/1/7/'],
 [14.732338600612058, '1864', '1874', 'https://cite.case.law/how-pr/50/415/'],
 [14.707359945522786,
  '1856',
  '1866',
  'https://cite.case.law/abb-pr/6/329/1960947/'],
 [14.670657669092202, '1886', '1896', 'https://cite.case.law/ri/19/724/'],
 [14.566955746993418, '1942', '1952', 'https://cite.case.law/alaska/13/194/'],
 [14.398396302568635, '1922', '1982', 'https://cite.case.law/va-cir/3/491/'],
 [14.34012358703439, '1849', '1879', 'https://cite.case.law/walker/3/497/'],
 [14.257579407367334, '1966', '1976', 'https://cite.case.law/pa-d-c3d/1/303/'],
 [14.125519234426225, '1898', '1988', 'https://cite.case.law/va-cir/13/536/'],
 [14.034800971969426,
  '1838',
  '1858',
  'https://cite.case.law/va/55/674/6732990/'],
 [13.689714724625253, '1887', '1897', 'https://cite.case.law/jahn/14/333/'],
 [13.401673514649849,
  '1855',
  '1865',
  'https://cite.case.law/how-pr/28/187/2221997/'],
 [13.401673514649849,
  '1855',
  '1865',
  'https://cite.case.law/how-pr/28/187/2220427/'],
 [13.221398052557738,
  '1897',
  '1887',
  'https://cite.case.law/ohio-cir-dec/1/526/'],
 [13.11175468539752,
  '1907',
  '1927',
  'https://cite.case.law/ill-app/245/636/3372136/'],
 [12.985752107039, '1858', '1868', 'https://cite.case.law/barb/50/32/'],
 [12.962352692606776, '1867', '1887', 'https://cite.case.law/haw/8/658/'],
 [12.856998512153993, '1927', '1937', 'https://cite.case.law/mo-app/232/417/'],
 [12.313820843947783, '1948', '1958', 'https://cite.case.law/misc-2d/30/127/'],
 [12.15496189758153, '1854', '1884', 'https://cite.case.law/walker/3/57/'],
 [12.15496189758153, '1854', '1884', 'https://cite.case.law/walker/3/54/'],
 [12.059444807692831,
  '1906',
  '1916',
  'https://cite.case.law/ohio-cc-ns/32/555/'],
 [12.055245637000501,
  '1957',
  '1967',
  'https://cite.case.law/conn-supp/26/450/'],
 [11.871110634774956, '1869', '1889', 'https://cite.case.law/haw/8/609/'],
 [11.845065583796126, '1858', '1868', 'https://cite.case.law/how-pr/35/184/'],
 [11.532317849097117, '1922', '1932', 'https://cite.case.law/del/35/76/'],
 [11.167260912593889, '1860', '1870', 'https://cite.case.law/barb/67/132/'],
 [11.100592523033091,
  '1985',
  '1995',
  'https://cite.case.law/ill-ct-cl/47/106/'],
 [11.054423074548804, '1828', '1858', 'https://cite.case.law/grant/2/388/'],
 [10.998948155975414, '1968', '1978', 'https://cite.case.law/ill-ct-cl/31/1/'],
 [10.931637495088466,
  '1919',
  '1929',
  'https://cite.case.law/ohio-np-ns/27/481/'],
 [10.907994130178597, '1875', '1885', 'https://cite.case.law/haw/5/675/'],
 [10.82762597182751, '1888', '1898', 'https://cite.case.law/ohio-np/8/627/'],
 [10.536071655718404,
  '1944',
  '1954',
  'https://cite.case.law/ohio-law-abs/74/337/'],
 [10.503807230236356,
  '1888',
  '1898',
  'https://cite.case.law/ohio-cir-dec/7/453/'],
 [10.169472463009074, '1948', '1958', 'https://cite.case.law/misc-2d/10/363/'],
 [9.89076811180347, '1936', '1946', 'https://cite.case.law/f-supp/80/79/'],
 [9.89076811180347, '1936', '1946', 'https://cite.case.law/f-supp/80/267/'],
 [9.89076811180347, '1936', '1946', 'https://cite.case.law/f-supp/80/266/'],
 [9.791376979574522, '1876', '1886', 'https://cite.case.law/haw/5/695/'],
 [9.596173499155052,
  '1888',
  '1898',
  'https://cite.case.law/jahn/20/707/1515720/'],
 [9.532767870238098, '1860', '1880', 'https://cite.case.law/walker/3/499/'],
 [9.16465788884263, '1760', '1790', 'https://cite.case.law/us/4/427/'],
 [9.109503326057686, '1857', '1867', 'https://cite.case.law/how-pr/34/418/'],
 [9.109503326057686, '1857', '1867', 'https://cite.case.law/how-pr/34/239/'],
 [8.790352183953367,
  '1887',
  '1897',
  'https://cite.case.law/ohio-np/5/247/1528095/'],
 [8.790352183953367,
  '1887',
  '1897',
  'https://cite.case.law/ohio-np/5/247/1527965/'],
 [8.479099650403226, '1888', '1898', 'https://cite.case.law/jahn/22/630/'],
 [8.15217759589184, '1784', '1794', 'https://cite.case.law/va/1/368/'],
 [8.050133530403317, '1949', '1959', 'https://cite.case.law/misc-2d/16/9/'],
 [8.050133530403317, '1949', '1959', 'https://cite.case.law/misc-2d/16/72/'],
 [8.050133530403317, '1949', '1959', 'https://cite.case.law/misc-2d/16/10/'],
 [7.852282046216471, '1825', '1835', 'https://cite.case.law/miles/1/357/'],
 [7.59438126944334, '1851', '1871', 'https://cite.case.law/barb/63/60/'],
 [7.089818955123682, '1861', '1881', 'https://cite.case.law/walk/4/426/'],
 [6.48718674285974, '1827', '1837', 'https://cite.case.law/sc-eq/16/459/'],
 [6.422605694618546, '1863', '1883', 'https://cite.case.law/walk/4/28/'],
 [6.414900345615853, '1879', '1889', 'https://cite.case.law/haw/8/627/'],
 [6.117300056335036, '1858', '1868', 'https://cite.case.law/barb/66/310/'],
 [6.117300056335036, '1858', '1868', 'https://cite.case.law/barb/66/160/'],
 [5.827403625027077, '1885', '1895', 'https://cite.case.law/jahn/18/814/'],
 [5.827403625027077, '1885', '1895', 'https://cite.case.law/jahn/18/790/'],
 [5.282092414747416, '1939', '1919', 'https://cite.case.law/balt-c-rep/4/21/'],
 [3.7822192802685084, '1781', '1871', 'https://cite.case.law/f-cas/5/1056/'],
 [3.7370671544160294, '1816', '1826', 'https://cite.case.law/del-cas/3/227/'],
 [3.556758279554999, '1779', '1879', 'https://cite.case.law/f-cas/8/975/'],
 [3.4364673943150845, '1788', '1878', 'https://cite.case.law/f-cas/5/13/'],
 [3.2506909297445823, '1782', '1872', 'https://cite.case.law/f-cas/14/164/'],
 [3.2506909297445823, '1782', '1872', 'https://cite.case.law/f-cas/14/163/'],
 [3.1449321943600546, '1786', '1876', 'https://cite.case.law/f-cas/9/406/']]
{'too_many': 524, 'not_enough': 596, 'matched': 430, 'too_close': 186}
ChefAndy commented 3 years ago

Is this actionable? Should we just leave it here in hope of picking it up again?