search

NeurodataWithoutBorders / nwb_benchmarks

Benchmarking for NWB-related operations.
https://nwb-benchmarks.readthedocs.io/en/latest/
Other
4 stars 2 forks source link

MatNWB timing #56

Open CodyCBakerPhD opened 1 month ago

CodyCBakerPhD commented 1 month ago

It would also be great if we could find a way to run targetted timing operations via MatNWB (including the native ros3 method), similar to how we figured out how to do web based timings #30

oruebel commented 1 month ago

We probably can't do the timing from Python directly, because it would likely include the time for starting up Matlab and importing MatNWB etc. (rather than just the operations we want to time). However, if we do the timing in Matlab itself, could we "just" run Matlab scripts that return the timing result back to Python (e.g., by writing to a file) and then in the test we can return the metric that Matlab tracked. For the network tracking tests, I think those could be run in a similar way. The network tracker records all traffic and then we filter by process ID, i.e., instead of using the process id for our Python process we would need to track the process that Matlab is running. I.e., as long as we can figure out the id of the process we need to track we should be able to do the network tracking as well.