agenda-devOps 10/6 -- PLEASE COMMENT

[jessb0t]

Retrospective (5 mins; reflect on processes that did/did not work) Sprint review (10 mins: review what was completed/ not completed) Planning (45 mins: discuss/plan work for next sprint and finalize milestone)

[jessb0t]

Overview of Achievements Apr-Oct

• PEPPER pipeline: :brain: Reliably pre-process EEG data with a fully-integrated and parameterized pipeline. :whale: Build container images for easy development. :octopus:Run on HPC clusters using prepared scripts. :test_tube:Run a comprehensive test-suite on all software features.

• build-out of HPC structure v1, in process of shifting to v2

• creation of template GH repos for tools, datasets, and analyses

• cleanup of existing GH repos

• creation of baseline lab management manual

• creation of baseline lab tech manual (currently shifting to next iteration w/update of HPC)

• establishment of baseline programming and naming conventions

• launch of Get with Git program and onboarding of all lab members

• revamp of People page on website

• submission of two new IRBs (putt-putt, generic-eeg) and multiple amendments

• full review and revamp of nearly all existing wiki tech pages

• addition of wiki welcome, onboarding, around the lab, and etiquette sections

• on the verge of v 0.01 release of auto-scoring script for lab instruments

• recruitment and onboarding of Fall 2021 jRAs

GitHub: Expectations on timeline for updating readme/contributing

devOps Review these items together. Delete or integrate.

[F-said]

Pepper Updates

• test cases pass except for one

  

  • caveat, on certain tasks, ica_raw fails https://github.com/NDCLab/pepper-pipeline/issues/345. Will loop in @yanbin-niu
• CMI data converted back into tar format, saved ~3TB of storage

HPC Updates

To summarize these new features:

• HPC now logs automatic actions to others/logs

• HPC now clears if logs go over 5 GB

• New permissions and structure are set data to be moved into legacy after migration meetings

• Script to print out a user-friendly read-out of user types

• Scripts and meetings created for active data-collection to move data

  • Missing_link @apoly1 (Thursday)
  • Rwe_alpha @emach039 (Friday)
  • Social_context @SarahMalykke (Thursday)

• 93 progress

  • 105

  • 106

  • 113

  • 110

  • 107

  • 111

  • 112

  • 108

  • 109

HPC Next Actions

• 79

• 80

• 115

• Ping IRCC on old members and accidental deletion

Pepper Next Actions

• Forward exceptions and reformat run.py to detect forwarded exceptions
• Resolve #345
• Incorp wiki edits from PR