This code fits my purpose of importing Neubot and Glasnost data into MongoDB. It does so by adding a new task, preprocess, that takes care of converting data collected by other tools in the yamloo format. Since I think this code makes ooni-pipeline more useful, I'd like to contribute it back.
What do you think? Could this code be merged? Are there changes that you'd rather see implemented before that happens?
Hi @hellais,
This pull request contains the changes that I made to ooni-pipeline last month to implement a meta pipeline to import Neubot and Glasnost data into MongoDB.
This code fits my purpose of importing Neubot and Glasnost data into MongoDB. It does so by adding a new task, preprocess, that takes care of converting data collected by other tools in the yamloo format. Since I think this code makes ooni-pipeline more useful, I'd like to contribute it back.
What do you think? Could this code be merged? Are there changes that you'd rather see implemented before that happens?