Access Santa Clara court data, API and determine if there are other considerations

[ying1]

Task:

• [x] Determine if there is an API to access Santa Clara court data.
  • See: https://docs.google.com/document/d/19goNGjxYqH0zYyddme_JAGmk8JM4dKMflDnLG1yajD8
• [x] Attempt to scrape data. See if there are limitations on the site and will it block.
  • No limitations on scraping.
• [ ] Are there more data that we need? This would depend on evaluation of Tulsa's courtbot and see if they have other information needed.

[rkiddy]

FYI, the table schema I am using is:

mysql> desc court_calendars;
+--------------+-------------+------+-----+---------+-------+
| Field        | Type        | Null | Key | Default | Extra |
+--------------+-------------+------+-----+---------+-------+
| pk           | int(11)     | NO   | PRI | NULL    |       |
| county_pk    | int(11)     | YES  |     | NULL    |       |
| name         | varchar(31) | YES  |     | NULL    |       |
| abbreviation | char(3)     | YES  |     | NULL    |       |
| cal_speak    | varchar(31) | YES  |     | NULL    |       |
+--------------+-------------+------+-----+---------+-------+

mysql> desc court_calendar_depts;
+--------------+-------------+------+-----+---------+-------+
| Field        | Type        | Null | Key | Default | Extra |
+--------------+-------------+------+-----+---------+-------+
| pk           | int(11)     | NO   | PRI | NULL    |       |
| calendar_pk  | int(11)     | YES  |     | NULL    |       |
| display_date | varchar(20) | YES  |     | NULL    |       |
| department   | varchar(8)  | YES  |     | NULL    |       |
+--------------+-------------+------+-----+---------+-------+

mysql> desc court_cases;
+----------------+----------------+------+-----+---------+-------+
| Field          | Type           | Null | Key | Default | Extra |
+----------------+----------------+------+-----+---------+-------+
| pk             | int(11)        | NO   | PRI | NULL    |       |
| dept_pk        | int(11)        | YES  |     | NULL    |       |
| case_number    | varchar(31)    | YES  |     | NULL    |       |
| parties        | varchar(10240) | YES  |     | NULL    |       |
| scheduled_time | varchar(31)    | YES  |     | NULL    |       |
+----------------+----------------+------+-----+---------+-------+

mysql> select * from court_calendars;
'+----+-----------+------------------------------+--------------+---------------------+
| pk | county_pk | name                         | abbreviation | cal_speak           |
+----+-----------+------------------------------+--------------+---------------------+
|  1 |         1 | Civil                        | CIV          | Civil               |
|  2 |         1 | Probate                      | PRO          | Probate             |
|  3 |         1 | Family - Juvenile Dependency | FAM          | Family              |
|  4 |         1 | Traffic                      | TRF          | Traffic             |
|  5 |         1 | Criminal - Hall of Justice   | CHJ          | Criminalhoj         |
|  6 |         1 | Criminal - Palo Alto         | CPA          | CriminalPaloAlto    |
|  7 |         1 | Criminal - South County      | CSC          | CriminalSouthCounty |
|  8 |         1 | Juvenile Justice             | JUV          | Juvenile            |
+----+-----------+------------------------------+--------------+---------------------+

[ying1]

The current API has what we need for the approach that we are doing. Closing this issue.