freelawproject / recap

This repository is for filing issues on any RECAP-related effort.
https://free.law/recap/
12 stars 4 forks source link

RECAP Promulgating Garbage Party/Attorney Data #262

Closed PlainSite closed 5 years ago

PlainSite commented 5 years ago

See, for example:

https://archive.org/download/gov.uscourts.dcd.194576/

This case has hundreds of attorneys mostly from USDOJ who don't belong there. The JSON from Mike's new RECAP code is 20.4MB. The old XML was 1.4KB.

See also:

https://archive.org/download/gov.uscourts.insd.82658/

Same deal.

mlissner commented 5 years ago

Thanks for filing this. I addressed it the day after you mentioned it on Twitter in this issue: https://github.com/freelawproject/courtlistener/issues/899. Now it's a matter of updating all the errant dockets, but that's taking longer.

PlainSite commented 5 years ago

Unclear if related or not, but some dockets, such as the 1.1GB (not a typo) JSON file here, continue to persist on the Internet Archive site and break importer code due to memory issues:

https://archive.org/download/gov.uscourts.ilnd.293765/

The same case's XML docket is 4.1MB.

mlissner commented 5 years ago

Thanks, we can verify this after everything is re-uploaded, if desired. That's definitely not good.