AllenInstitute / npc_sessions

Tools for accessing and packaging data from behavior and epyhys sessions from the Mindscope Neuropixels team, in the cloud.
1 stars 1 forks source link

`702136_2024-03-07` units data missing #95

Open bjhardcastle opened 4 months ago

bjhardcastle commented 4 months ago
Traceback (most recent call last):
  File "/opt/conda/lib/python3.9/site-packages/npc_ephys/units.py", line 269, in make_units_table_from_spike_interface_ks25
    _ = future.result()
  File "/opt/conda/lib/python3.9/concurrent/futures/_base.py", line 439, in result
    return self.__get_result()
  File "/opt/conda/lib/python3.9/concurrent/futures/_base.py", line 391, in __get_result
    raise self._exception
  File "/opt/conda/lib/python3.9/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/opt/conda/lib/python3.9/site-packages/npc_ephys/units.py", line 188, in _device_helper
    df_device_metrics["default_qc"] = spike_interface_data.default_qc(
  File "/opt/conda/lib/python3.9/site-packages/npc_ephys/spikeinterface.py", line 400, in default_qc
    self.get_correct_path(
  File "/opt/conda/lib/python3.9/site-packages/npc_ephys/spikeinterface.py", line 141, in get_correct_path
    path = npc_io.from_pathlike("/".join(str(path) for path in path_components))
  File "/opt/conda/lib/python3.9/site-packages/npc_io/file_io.py", line 65, in from_pathlike
    raise FileNotFoundError(
FileNotFoundError: In attempting to handle a path containing '#', we couldn't find s3://codeocean-s3datasetsbucket-1u41qdg42ur9/39967033-3013-4e55-98a4-39e0ae766f20/curated/experiment1_Record Node 104#Neuropix-PXI-100.ProbeF-AP_recording1/properties/default_qc.npy

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/opt/conda/lib/python3.9/runpy.py", line 197, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/opt/conda/lib/python3.9/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/opt/conda/lib/python3.9/site-packages/npc_sessions/scripts/write_sessions_to_nwb.py", line 90, in <module>
    main()
  File "/opt/conda/lib/python3.9/site-packages/npc_sessions/scripts/write_sessions_to_nwb.py", line 86, in main
    write_sessions_to_cache(**kwargs)  # type: ignore[misc, arg-type]
  File "/opt/conda/lib/python3.9/site-packages/npc_sessions/scripts/write_sessions_to_nwb.py", line 75, in write_sessions_to_cache
    helper(
  File "/opt/conda/lib/python3.9/site-packages/npc_sessions/scripts/write_sessions_to_nwb.py", line 27, in helper
    npc_sessions.write_and_upload_session_nwb(
  File "/opt/conda/lib/python3.9/site-packages/npc_sessions/utils/cache.py", line 192, in write_and_upload_session_nwb
    path = session.write_nwb_zarr(path=path, metadata_only=metadata_only)
  File "/opt/conda/lib/python3.9/site-packages/npc_sessions/sessions.py", line 369, in write_nwb_zarr
    nwb = self.nwb if not metadata_only else self.metadata
  File "/opt/conda/lib/python3.9/site-packages/npc_sessions/sessions.py", line 332, in nwb
    analysis=self._analysis,
  File "/opt/conda/lib/python3.9/site-packages/npc_io/cached_property.py", line 78, in __get__
    val = self.func(instance)
  File "/opt/conda/lib/python3.9/site-packages/npc_sessions/sessions.py", line 750, in _analysis
    modules.append(self.all_spike_histograms)
  File "/opt/conda/lib/python3.9/site-packages/npc_io/cached_property.py", line 78, in __get__
    val = self.func(instance)
  File "/opt/conda/lib/python3.9/site-packages/npc_sessions/sessions.py", line 2632, in all_spike_histograms
    for probe in sorted(set(self.units.electrode_group_name[:])):
  File "/opt/conda/lib/python3.9/site-packages/npc_io/cached_property.py", line 78, in __get__
    val = self.func(instance)
  File "/opt/conda/lib/python3.9/site-packages/npc_sessions/sessions.py", line 1429, in units
    for column in self._units.columns:
  File "/opt/conda/lib/python3.9/site-packages/npc_io/cached_property.py", line 78, in __get__
    val = self.func(instance)
  File "/opt/conda/lib/python3.9/site-packages/npc_sessions/sessions.py", line 1368, in _units
    units=npc_ephys.make_units_table_from_spike_interface_ks25(
  File "/opt/conda/lib/python3.9/site-packages/npc_ephys/units.py", line 280, in make_units_table_from_spike_interface_ks25
    raise RuntimeError(
RuntimeError: Error fetching units for 702136_2024-03-07 - see original exception above/below