After running the behavior_only_nwb_writer script on the ticket/2559/dev branch to produce VBN data Corbett found two issues.
Firstly, behavior_session_1104326011.nwb could not be loaded due to a missing lab_meta_data object being written. The error here shows up while using BehaviorSession.from_nwb_path method the file will crash saying there is no behavior_session_id. This is due to the nwb file being written with no labe_meta_data object (BehaviorMetadata in our codebase). This was fixed by re-running the processing. Not sure completely why this failure happens as when using a pdb to check the nwb file object before it is finalized, the lab_meta_data is there, however it is missing when the file is loaded. A further set of behavior session ids were found later [1015173833, 1044609282, 1045537410, 1050623343, 1051333618, 1052374521, 1059876823, 1062268126, 1065499125, 1065893902, 1078597979, 1080300041, 1086795989, 1087741158, 1096694612, 1096906308, 1105260127, 1105774164, 1113953350, 1115115784]. These files have been fixed by @morriscb as of Nov 22nd and just need to be placed in the release candidate directory. They are currently in: /allen/aibs/informatics/chris.morrison/ticket-2559/re_run_no_lab_metadata
The second issue is that the behavior session id in the nwb file did not line up with the id in the file name. The solution was again re-running the data. This may be caused by some collision between running multiprocessing across multiple machines however I have not tested things that deep. The list of files is listed below and have been recreated and tested by @morriscb as of Nov 22nd.
After running the
behavior_only_nwb_writerscript on the ticket/2559/dev branch to produce VBN data Corbett found two issues.Firstly, behavior_session_1104326011.nwb could not be loaded due to a missing lab_meta_data object being written. The error here shows up while using
BehaviorSession.from_nwb_pathmethod the file will crash saying there is nobehavior_session_id. This is due to the nwb file being written with nolabe_meta_dataobject (BehaviorMetadata in our codebase). This was fixed by re-running the processing. Not sure completely why this failure happens as when using a pdb to check the nwb file object before it is finalized, the lab_meta_data is there, however it is missing when the file is loaded. A further set of behavior session ids were found later [1015173833, 1044609282, 1045537410, 1050623343, 1051333618, 1052374521, 1059876823, 1062268126, 1065499125, 1065893902, 1078597979, 1080300041, 1086795989, 1087741158, 1096694612, 1096906308, 1105260127, 1105774164, 1113953350, 1115115784]. These files have been fixed by @morriscb as of Nov 22nd and just need to be placed in the release candidate directory. They are currently in: /allen/aibs/informatics/chris.morrison/ticket-2559/re_run_no_lab_metadataThe second issue is that the behavior session id in the nwb file did not line up with the id in the file name. The solution was again re-running the data. This may be caused by some collision between running multiprocessing across multiple machines however I have not tested things that deep. The list of files is listed below and have been recreated and tested by @morriscb as of Nov 22nd.
['behavior_session_1131497514.nwb' 'behavior_session_1129839807.nwb', 'behavior_session_1139696226.nwb', 'behavior_session_1130095839.nwb', 'behavior_session_1153972744.nwb', 'behavior_session_1132234194.nwb', 'behavior_session_1135831584.nwb', 'behavior_session_1124666577.nwb', 'behavior_session_1138481410.nwb', 'behavior_session_1136957631.nwb', 'behavior_session_1131794350.nwb', 'behavior_session_1131651767.nwb', 'behavior_session_1137231396.nwb', 'behavior_session_1132878595.nwb', 'behavior_session_1135107017.nwb', 'behavior_session_1134858949.nwb', 'behavior_session_1133612875.nwb', 'behavior_session_1129644205.nwb', 'behavior_session_1135345527.nwb', 'behavior_session_1139969640.nwb', 'behavior_session_1130346783.nwb', 'behavior_session_1130545530.nwb', 'behavior_session_1125919448.nwb', 'behavior_session_1139401210.nwb', 'behavior_session_1123790128.nwb', 'behavior_session_1125489477.nwb', 'behavior_session_1128009932.nwb', 'behavior_session_1134093278.nwb', 'behavior_session_1124034527.nwb', 'behavior_session_1138253355.nwb', 'behavior_session_1134322824.nwb', 'behavior_session_1125254502.nwb', 'behavior_session_1127063812.nwb', 'behavior_session_1136784476.nwb', 'behavior_session_1124457106.nwb', 'behavior_session_1132591016.nwb', 'behavior_session_1133403910.nwb', 'behavior_session_1131311228.nwb', 'behavior_session_1128496433.nwb', 'behavior_session_1132744410.nwb', 'behavior_session_1123267579.nwb', 'behavior_session_1127250255.nwb', 'behavior_session_1138784766.nwb', 'behavior_session_1125704043.nwb', 'behavior_session_1132435788.nwb', 'behavior_session_1137822288.nwb', 'behavior_session_1133879512.nwb', 'behavior_session_1136593566.nwb', 'behavior_session_1128706822.nwb', 'behavior_session_1138028033.nwb', 'behavior_session_1126881717.nwb', 'behavior_session_1124236574.nwb', 'behavior_session_1126117235.nwb', 'behavior_session_1135551120.nwb', 'behavior_session_1128230936.nwb', 'behavior_session_1129048947.nwb', 'behavior_session_1127440350.nwb']