Loop through and validate articles’ JSON representations - Githubissues

guardian / playground

Come to the playground and peruse the sand castles.

2 stars 0 forks source link

Loop through and validate articles’ JSON representations #22

Open mxdvl opened 2 years ago

mxdvl commented 2 years ago

repo: https://github.com/mxdvl/dcr-json-comparison people: @mxdvl

What is this project about

Look for articles and check whether their JSON representation is valid.

Compare the result of validating with Ajv and parsing with Zod.

The most interesting parts of this code are:

using an async generator to get an infinite stream of articles from CAPI
saving the data to disk to allow the script to be stopped with no data loss