more fixes to stimulus processing

[jihyunbak]

Remaining stim pipeline error fixes that were missed in the recently closed PR #85 .

Output from running pytest --basetemp=tmp -sv -n 12 test_catscan.py:

• With RESAMPLE_DATA=True in the updated test_catscan.py, getting some memory errors. (I used -n 12 though; will try using a smaller n)

  ==================================== short test summary info =====================================
  FAILED test_catscan.py::test_nwb_builder[RVG16_B07] - numpy.core._exceptions._ArrayMemoryError:...
  FAILED test_catscan.py::test_nwb_builder[RVG16_B08] - numpy.core._exceptions._ArrayMemoryError:...
  FAILED test_catscan.py::test_nwb_builder[RVG16_B06] - numpy.core._exceptions._ArrayMemoryError:...
  FAILED test_catscan.py::test_legacy_nwb_builder[R56_B10] - numpy.core._exceptions._ArrayMemoryE...
  FAILED test_catscan.py::test_nwb_builder[RVG16_B10] - numpy.core._exceptions._ArrayMemoryError:...
  ======================= 5 failed, 7 passed, 1 warning in 364.89s (0:06:04) =======================

  • Update: serial run (no -n option) still fails for some blocks, and this was on n0001

    ==================================== short test summary info =====================================
    FAILED test_catscan.py::test_nwb_builder[RVG16_B07] - numpy.core._exceptions._ArrayMemoryError:...
    FAILED test_catscan.py::test_nwb_builder[RVG16_B08] - MemoryError
    FAILED test_catscan.py::test_nwb_builder[RVG16_B10] - numpy.core._exceptions._ArrayMemoryError:...
    ====================== 3 failed, 9 passed, 1 warning in 7126.49s (1:58:46) =======================

• With RESAMPLE_DATA=False, all passing except TIMIT block (number of stim onsets mismatch)

  ==================================== short test summary info =====================================
  FAILED test_catscan.py::test_nwb_builder[RVG16_B08] - AssertionError: Incorrect number of stimu...
  ====================== 1 failed, 11 passed, 1 warning in 339.06s (0:05:39) =======================

  This is the full error message, and it is coming from TIMIT tokenizer around L36:

  AssertionError: Incorrect number of stimulus onsets found. Expected 998, found 637. Perhaps you are not using the correct tokenizer?

[jihyunbak]

@BouchardLab/nsds_data_dev Let me merge this without review … but just sending a notification