-
The ETL pipelines, when working with torque, only call csv2wiki to create mostly empty pages. In fact, we had to add options to csv2wiki to disable a lot of its features, and added things like helper…
-
-
In some of our projects, we have ETL/preprocessing pipelines that take multiple inputs and produce a single output dataset. In some current implementations we've been using the scikit-learn transforme…
-
As an informatics developer, I would like to better understand the optical physiology sine dewarping python module, so that it will be easier to maintain (easier to bugfix and/or refactor).
Validatio…
-
**Background context**
Our data streaming pipeline identifies data change events triggered by any application in the Reapit suite of products. This will trigger an ETL operation involving our platfor…
-
Initially, we made the singularity container to make it easier to lock down Suite2P and all its dependencies. Now, we seem to be using the container more generally for anything in this repo. I see a f…
-
http://confluence.corp.alleninstitute.org/display/IT/Informatics+processing+support
As part of this work, you may consider entering a new issue(s) for a way to automate/improve these tasks.
This ope…
-
It would be ideal to update the names of keys in input json file provided by the ophys_suite_2p_strategy.
Tasks:
- [x] Update the names of schema in ophys_etl (see attached PR)
- [x] Create Jira …
-
The `MESOSCOPE_FILE_SPLITTING_QUEUE` calls a module/script from the `mesoscope_splitting` branch of https://github.com/AllenInstitute/brain_observatory_utils
(which depends on https://github.com/Allen…
-
As an informatics dev I would like to have semi-permanent authorization tokens for uploading images and the ability to automatically cull out of date images so that pipeline deployment and maintenance…
njmei updated
4 years ago