freelawproject / juriscraper

An API to scrape American court websites for metadata.
https://free.law/juriscraper/
BSD 2-Clause "Simplified" License
341 stars 98 forks source link

Texas Supreme Court opinions missing #193

Open anseljh opened 6 years ago

anseljh commented 6 years ago

The Texas Supreme Court's clerk tweeted that he thought it'd be cool if SCOTUS online dockets linked back to lower court online dockets. He included a URL to one SCOTUS docket, which had a docket number for a Texas Supreme Court case, Pidgeon (15-0688).

I wanted to see if we could match the SCOTUS docket back to the SCOTX opinion on CourtListener using just the court and docket number. However, CourtListener does not have this SCOTX opinion! It was filed June 30, 2017. In fact, we don't have seem to have any SCOTX opinions from June 30 to July 5, 2017: https://www.courtlistener.com/?q=&type=o&order_by=dateFiled+desc&filed_after=2017-06-10&filed_before=2017-07-05&court=tex. However, the Pidgeon case does appear on SCOTX's weekly opinion page for June 30, 2017 (http://www.txcourts.gov/supreme/orders-opinions/2017/june/june-30-2017/).

We seem to be missing other recent SCOTX opinions as well.

I looked briefly at the Texas courts scraper, and it seems to be using a search form. However, there are also a weekly opinion pages, available here: http://www.txcourts.gov/supreme/orders-opinions/. I confirmed that you can indeed find the Pidgeon opinion through the form.

I did not check to see if other Texas courts' opinions are also missing.

anseljh commented 6 years ago

Thanks to @arderyp for investigating and suggesting a fix.

The Pidgeon opinion is now available: https://www.courtlistener.com/opinion/4444060/jack-pidgeon-and-larry-hicks-v-mayor-sylvester-turner-and-city-of-houston/?q=pidgeon&type=o&order_by=score+desc&stat_Precedential=on&court=tex

I think we can close this out once we verify it's working going forward, and that we got all the missing opinions.

mlissner commented 6 years ago

Looks like the back scrape I did worked OK. Don't know about going forward. I'm a bit worried how this happened in the first place.

brianwc commented 6 years ago

Well, we know the clerk, so could ask if the weekly report is the best/canonical source or whether both approaches should work to get everything.

On Nov 17, 2017 11:08 AM, "Mike Lissner" notifications@github.com wrote:

Looks like the back scrape I did worked OK. Don't know about going forward. I'm a bit worried how this happened in the first place.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/freelawproject/juriscraper/issues/193#issuecomment-345336520, or mute the thread https://github.com/notifications/unsubscribe-auth/AAT1OWn5PegpXzAW9mA4JRZudtMu7S5Dks5s3dmZgaJpZM4QfmSB .