search

datamade / court-scrapers

MIT License
2 stars 0 forks source link

turn comments into json #33

Open fgregg opened 4 months ago

fgregg commented 4 months ago

The comments field in the events table looks highly structure. Please turn into a json object.

antidipyramid commented 3 months ago

@fgregg Not all rows in the events table are in key: value form. For example, some rows have comments with values like Alias, Proof of service, or Citation To Discover Assets To POE.

For each row, we could create a JSON object and stuff any unstructured data into its own field, e.g. Proof of Service becomes {text: Proof of Service}. Would that work?

Also, should we make this transformation in the Python scrapers or as part of the SQL import process?

fgregg commented 3 months ago

let's hold off on this for now.